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1).  abstract 


'  "^The  objective  of  this  research  was  to  exaaine  the  effects  of  opera¬ 
tional  situations  upon  sonar  operators'  contact  reporting  behavior. 
Different  operational  situations  have  been  observed  to  lead  to  different 
sonar  contact  reporting  thresholds.  This  research  was  intended  to 
develop  a  nore  coaplete  and  quantitative  understanding  of  that  effect. 
The  aspects  to  be  investigated  were  suggested  by  statistical  decision 
theory.  *An  attitude  survey  involving  fleet  sonar  operators  and 
destroyer  officers  was  conducted  to  detersine  the  subjective  values  of 
five  decision-ssaking  variables  with  respect  to  seventeen  scenarios 
depicting  psacetiac  and  wartime  tactical  situations.  It  was  found  that 
sonar  contact  reporting  thresholds  were  principally  determined  by  the 
pex'ceived  consequences  of  nissed  contacts  and  of  delay  in  contact  re¬ 
porting.  It  was  also  found  that  the  assessnents  of  false  contact  con¬ 
sequences  were  very  inconsistent,  unlike  the  judgaents  with  respect  to 
the  other  decision  variables. 

The  second  phase  of  the  research  consisted  of  the  conduct  of  a 
sonar  detection  experiment,  in  which  the  influence  of  The  variable  ’’coh- 
ssand  attention"  on  performance  was  measured  to  give  an  objective  evalua¬ 
tion  of  the  effects  of  psychological  variables.  It  was  found  that  a 
"high"  level  of  command  attention  led  to  better  sonST"  contact  detection 
performance. 
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SUMMARY 


Oboeative 

The  objective  of  this  research  was  to  examine  the  effects 
of  various  operational  situations  upon  sonar  operators’  contact 
reporting  behavior.  The  act  of  reporting  a  contact  constitutes 
the  only  operationally  significant  definition  of  "detection," 
since,  in  the  absence  of  such  a  report,  a  ship  has  not  made  a 
"detection"  and  cannot  react  appropriately,  regardless  of  the 
state  of  mind  of  a  sonar  operator.  Different  operational  situ¬ 
ations  have  been  observed  to  lead  to  different  sonar  contact 
reporting  behaviors.  This  research  was  intended  to  develop  a 
more  complete  and  quantitative  understanding  of  that  effect, 
to  permit  more  accurate  prediction  of  its  influence  on  ASW 
performance,  and  to  suggest  means  for  modifying  reporting  be¬ 
havior,  if  necessary,  to  optimize  ASW  performance 

The  Attitude  Survey 

The  aspects  to  be  investigated  v.'ere  suggested  by  statis¬ 
tical  decision  theory.  This  theory  identifies  variables  which 
have  an  important  impact  on  optimum  decision  making.  For  the 
sequential  detection  situation,  these  variables  include:  (1) 
the  decision  criterion,  or  threshold;  (2)  the  consequences  of 
missed  detections;  fS)  the  consequences  of  false  detections; 

(4)  the  a  priori  probability  for  the  presence  of  a  target;  and 
{5j  the  "cost"  of  additional  observations.  For  the  case  of  the 
human  decision  maker,  it  has  often  been  postulated  that  the 
subjective  values  of  these  variables  influence  decision-making 
behavior  in  a  manner  similar  to  the  mathematical  model.  The 
first  phase  of  the  research  focused  on  obtaining  the  judgments 
of  fleet  sonar  operators  and  destroyer  officers  regarding  the 
subjective  values  of  these  decision-making  variables  for  each 
of  17  operational  scenarios,  iv’hich  depicted  a  wide  range  of 
peacetime  and  v;artime  destroyer  operations.  The  individual 


scenario  descriptions  were  printed  on  cards  and  each  of  the 
personnel  interviewed  was  requested  to  place  the  17  cards  in 
rank  order  according  to  sets  of  instructions  directing  atten¬ 
tion  to  the  five  decision-making  variables.  With  few  ex¬ 
ceptions,  the  CO,  XO,  operations  officer,  ASW  officer,  weap¬ 
ons  officer,  and  the  sonar  operators  of  20  destroyers  were 
interviewed,  involving  a  total  of  99  officers  and  119  sonar 
operators . 

By  appropriate  psychometric  scaling  methods,  the  judgmen¬ 
tal  data  obtained  in  the  survey  provided  not  only  information 
concerning  the  rank  order  of  the  scenarios  on  the  various 
decision-variable  dimensions,  but  their  separations  along  these 
dimensions  as  well,  based  on  the  variability  in  responses. 

The  principal  findings  of  the  scalir  g  of  the  tactical  scenarios 
on  these  psychological  dimensions  were: 

1.  Sonar  contact  reporting  thresholds  were  principally 
determined  by  the  subjective  assessments  of  the 
consequences  of  missed  contacts  and  of  the  conss’- 
quences  of  delay  in  contact  reporting  (i.e.,  the 
’’cost"  of  additional  observations).  The  judgments 
of  these  consequences  for  each  scenario  were  vtsscn- 
tially  identical,  and  result  from  what  we  might 
descriptively  call  the  "threat*'  inherent  in  the 
tactical  situations.  To  a  lesser  degree,  the 
reporting  thresholds  were  also  found  to  depend  upon 
the  judged  probability  of  making  submarine  oontactj 
and  the  judged  consequences  of  false  contacts , 

These  relationships  were  expected. 

2.  The  following  result  was  unexpected.  While  assess¬ 
ments  of  the  scenarios  with  respect  to  reporting 
thresholds 3  missed  contact  consequences j  probabil- 
ity  of  submarine  contact^  and  the  "cost"  of  observa¬ 
tions  were  very  consistent  across  all  personnel 
interviewed,  the  assessment  of  the  consequences  of 
false  contacts  was  very  inconsistent.  It  was  found 
that  55%  of  the  personnel  ranked  the  wartime  scenarios 
as  having  the  most  severe  false  contact  consequences, 
28%  of  the  personnel  ranked  the  wartime  scenarios  as 
having  the  least  severe  false  contact  consequences, 
and  17%  of  the  personnel  followed  no  pattern  at  all 

in  ranking  the  scenarios  with  respect  to  false  con¬ 
tact  consequences. 


This  inconsistency  of  response  is  believed  to  result  froza 
the  peculiar  status  of  the  "false  contact"  in  ASW,  owing  to 
the  active  sonar  target  classification  problem.  False  con¬ 
tacts  are  the  most  frequent  occurrence  in  surface-ship  ASK 
operations  of  most  kinds,  but  no  tactic  or  equipment  exists 
which  can  easily  cope  with  the  resulting  attack  decision 
problem.  Owing  to  the  lack  of  any  easy  .answer  to  the  false 
contact  problem,  the  problem  itself  has  often  been  dealt  with 
superficially,  both  in  the  training  of  tactical  officers,  and 
in  various  research  efforts  concerned  l^ith  surface  ship  ASK. 

It  was  found  that  the  diverse  and  inconsistent  attitudes 
toward  false  contact  consequences  influenced  the  respondents* 
reporting  threshold  evaluations,  and  it  seems  likely  that 
these  attitudes  would  affect  decision-making  behavior  in  actual 
ASW  operations,  as  well.  Therefore,  we  regard  this  finding  as 
an  indication  of  a  significant  problem  area. 

In  addition  to  these  results,  the  application  of  multi¬ 
dimensional  scaling  techniques  to  the  survey  data  revealed 
what  appears  to  be  a  "personal  consequence"  dimension  to  the 
assessments  of  the  decision  variables,  in  addition  to  the  ex¬ 
pected  "tactical  consequence"  dimension;  and  the  responses  to 
a  questionnaire  related  to  problems  in  ASK  lent  further  in¬ 
sight  into  these  problem  areas. 

The  Detection  Experitr.ent 

The  second  phase  of  the  research  consisted  of  the  conduct 
of  a  sonar  detection  experiment,  in  which  the  influence  of  the 
"operational  situation"  on  performance  could  be  measured  to 
give  an  objective  evaluation  of  the  effects  of  psychological 
variables.  The  physical  "threat"  inherent  in  wartime  situa¬ 
tions  cannot  be  reproduced  in  an  experiment,  of  course,  but 
there  is  one  operationally  meaningful  variable  that  relates 
directly  to  perceived  importance  cf  the  tactical  situation, 
if  not  to  the  perceived  threat  per  se.  That  variable  is 
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"command  attention."  The  intent  was  to  measure  operator  detec¬ 
tion  performance  against  a  given  set  of  signals  in  a  setting 
Vfhich  would  first  minimize  apparent  command  attention;  and 
measure  performance  of  the  sane  operators  against  the  same 
stimuli  in  a  setting  in  which  maximum  possible  command  atten¬ 
tion  would  be  brought  to  bear,  thus  creating  two  situations 
genuinely  perceived  by  the  operators  to  be  of  very  different 
importance  with  respect  to  their  detection  performance. 

The  SQS-26  A-scan  display  was  used  to  generate  stimulus 
materials.  This  display  is  a  memory-type  device  which  pre¬ 
sents  a  history  of  sonar  pings  in  a  static  presentation.  This 
static  characteristic  permitted  the  use  of  still  photography 
to  create  a  realistic  representation  of  the  sonar  display,  by 
the  rear-projection  of  ping-by-ping  sequences  of  color  trans¬ 
parencies  onto  translucent  display  screens  of  the  sane  size 
as  the  sonar  display  CRT.  Seventy-two  6-ping  sequences  of 
color  slides  were  prepared,  forty-eight  of  which  contained 
FM  or  CW  targets  with  random  strengths,  locations,  and  motion, 
generated  by  the  sorar's  target  simulator;  and  twenty-four  of 
which  contained  only  reverberation  and  noise  produced  by  an 
apparatus  constructed  for  this  purpose.  Presentation  of  these 
sequences  in  random  order  at  a  real-time  rate  resulted  in  a 
detection  task  of  approximately  three  hours  duration. 

During  the  course  of  a  vieek,  18  experienced  SQS-26  sonar 
operators  performed  this  5-hour  detection  task.  During  this 
period  the  operators  were  asked  to  report  any  contacts  which 
they  felt  they  would  report  aboard  their  ship  during  routine 
operations.  Responses  were  required  only  when  they  wished  to 
report  a  contact,  in  which  case  a  push  button  was  to  be  actu¬ 
ated,  and  the  target  range,  bearing,  and  other  information 
were  to  be  recorded  in  a  contact  reporting  booklet.  The  set¬ 
ting  for  this  "low  command  attention"  phase  was  that  of  an 
experiment  conducted  for  the  Navy  by  civilian  researchers, 
but  without  explicit  consequences  for  either  errors  or 
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error-free  perforraance  of  the  task-  The  origin  of  the  stimulus 
materials  was  never  discussed  with  the  sonarmen  and  knowledge 
of  results  was  never  given. 

In  contrast,  when  the  same  sonarmen  arrived  during  the 
subsequent  week,  a  U.  S.  Navy  Commander,  in  uniform,  was 
present  in  the  room-  lie  made  a  statement  to  the  men  follnw- 
ing  this  guideline: 

The  exercise  last  week  was,  in  reality,  just 
a  warui-up  for  the  very  important  task  I  want 
you  to  perform  today.  In  the  interest  of  de¬ 
veloping  optimum  tactics  against  the  Soviet 
submarine  threat,  you  are  being  asked  to  view 
a  series  of  recently  acquired  data  where  it 
is  kno'wn  that  a  number  of  targets  may  be  de¬ 
tectable.  Security  prevents  my  discussing 
the  nature  of  these  data  in  detail,  but  it 
is  extremely  important  that  every  valid  con¬ 
tact  be  identified  as  such.  Our  estimate  of 
the  threat  clearly  depends  on  the  most  accu¬ 
rate  information  we  can  get  in  this  respect. 

Therefore ,  please  report  any  contact  that 
you  feel  qualifies  as  a  ''possible  sub."  Re¬ 
port  at  the  earliest  point  in  the  sequence 
where  you  feel  such  a  report  should  be  made. 

Following  this  statement,  the  men  .-jere  given  response  booklets 
which  had  security  classification  markings  (unlike  the  first 
week's  response  booklets),  and  they  were  requested  to  perform 
another  5-hour  detection  task  (which  in  fact  employed  the  same 
stimulus  raatei'iais  that  were  used  in  the  first  iveek) , 

Thus,  the  setting  during  the  second  v:eek  was  quite  dif¬ 
ferent  from  tiiat  during  the  first.  Every  effort  was  made  to 
make  performance  of  the  detection  task  appear  relevant  and 
consequential  to  the  "operational  Navy,"  via  the  "high"  level 
of  command  attention  focused  upon  it.  The  results  of  the 
experiment  nay  be  summarized  as  follo'ws. 

1.  The  "high"  level  of  command  attention  resulted  in 
a  significant  improvement  in  detection  performance, 
compared  to  the  "low"  level,  by  reducing  FM  false 
reports  by  50^  while  reducing  FM  correct  reports  by 
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only  4%;  and  by  redu-ing  CK  false  reports  by  31% 
while  increasing  CK  correct  reports  by  20%.  The 
differential  effect  by  signal  type  is  attributed 
to  the  different  psychophysical  tasks  presented 
by  the  FM  and  CV;  portions  of  the  display. 

Each  sonar  contact  report  was  required  to  have  a 
contact  "quality"  judgnent,  using  "good,"  "fair," 
and  "raarginal"  contact  quality  categories.  It 
was  found  that  these  quality  judgments  had  diag¬ 
nostic  value;  that  is,  a  higher  percentage  of  the 
contacts  judged  to  be  in  the  "good"  category 
turned  out  to  be  true  target  contacts  (as  opposed 
to  false  target  reports)  than  in  the  "fair"  cate¬ 
gory,  and  so  on.  The  effect  of  the  "high"  level 
of  command  attention  teas  to  improve  target  dis¬ 
crimination  performance  in  every  contact  quality 
category,  for  both  types  of  signals.  For  example, 
for  Ff-l  targets  in  the  "good"  category,  the  propor¬ 
tion  of  corieut  reports  was  increased  from  74%  for 
the  "low"  level  of  command  attention  to  ‘>4%  for 
the  "high"  level.  Similar  improvements  were  seen 
in  the  other  categories. 

Each  sonarman  was  required  to  estimate  the  range 
of  each  contact  he  reported.  Daring  the  "high" 
level  of  command  attention,  a  19%  improvement  in 
target  range  estimation  performance  was  observed, 
compared  to  the  performance  at  the  "low"  level  of 
command  attention. 

On  a  Receiver  Operating  Characteristic  graph,  the 
"high"  level  of  command  attention  moved  the  CK 
operati.ig  point  away  from  the  operating  point  for 
the  "low"  level  almost  perpendicularly  to  the' 
"char. re"  diagonal,  in  a  direction  of  improved 
effective  signal  detectability;  and  the  displace- 
raent  of  the  FM  operating  point  had  approximately 
equal  components  of  perpendicular  movement,  cor¬ 
responding  to  improved  detectability,  and  parallel 
movenent,  corresponding  to  a  change  of  reporting 
criterion  in  the  direction  of  increased  "caution." 

Based  upon  certain  assumptions,  the  signal  detec¬ 
tion  theory  statistics  d'  and  S  were  calculated. 

It  was  seen  that,  on  the  average,  signal  detect¬ 
ability  was  greater  for  the  FM  signals  than  the 
CK  signals;  and  that  more  "strict"  reporting  cri¬ 
teria  (i.e.,  larger  values  of  S)  were  employed  for 
FM  signals  than  for  CK".  It  was  also  seen  that  the 
"high"  level  of  command  attention  brought  about  a 
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35%  improvement  in  FM  signal  detectability,  and  a 
64%  improvement  in  CK  signal  detectability,  com¬ 
pared  to  performance  at  the  "low"  level.  The 
reporting  criterion  concomitantly  increased  by 
103%  in  the  direction  of  "caution"  for  FM  signals, 
and  by  34%  for  CW  signals. 

Thus,  target  detection  performance  was  significantly 
better  during  the  high  command  attention  phase  than  the  low 
command  attention  phase  of  the  experiment.  However,  it  is 
very  important  to  stress  that  the  contrast  between  actual 
peacetime  (non-ASK  exercise)  and  wartime  target  detection 
and  reporting  behavior  would  stand  in  even  greater  contrast. 
While  the  sonarmen  were  asked  to  report  any  contacts  "which 
they  felt  they  would  report  aboard  their  ship  during  routine 
operations"  for  the  low  command  attention  phase,  the  setting 
was  obviously  one  of  a  detection  experiment,  which  places 
tho  emphrsis  on  malting  trrget  detect^'»n3,  end  implies  th?t 
there  are  targets  to  be  detected.  Furthermore,  there  was 
obviously  no  immediate  consequence  for  any  false  detections 
that  might  be  made.  In  contrast,  the  actual  routine  peace¬ 
time  operational  setting  carries  with  it  a  very  low  probabil- 
ity  of  making  a  valid  target  contact;  and  there  is  an  immediate 
consec^uence  to  reporting  false  target  contacts,  in  that  they 
are  brought  to  the  attention  of  command.  The  results  of  the 
attitude  survey,  anecdotal  evidence  collected  from  the  survey 
respo:H  snts ,  and  the  results  of  ASK  exercise  reporting  per¬ 
formance  coiupared  to  non-exercise  contact  reporting  indicate 
that  the  routine  peacetime  sonar  contact  reporting  threshold 
is  typically  more  "strict"  than  that  employed  during  the  low 
command  attention  phase  of  this  detection  experiment.  Thus, 
the  i:ffect  of  the  high  level  of  command  attention  upon  ASK 
perforrance  at  the  onset  of  war  could  be  expected  to  bring 
about  the  improved  "effective  signal  detectability"  which  we 
have  seen  to  occur  in  the  detection  experiment:  and  to  bring 
about  an  overall  increase  in  the  number  of  target  reports,  as 
compare^  to  routine  peacetime  operations,  by  lowering  the 


reporting  threshold  to  the  conparatively  "free"  values  observed 
in  both  phases  of  the  detection  experinent- 

Conolusions 

In  the  operational  sonar  detection  situation,  the  noise/ 
reverberation  background  is  an  insignificant  source  of  "false" 
responses,  compared  with  that  unfortunately  large  class  of 
objects  which  give  rise  to  "false  contacts."  "False  contacts" 
produce  real  echoes,  whose  characteristics  differ  significantly 
from  the  noise  background,  principally  in  having  a  degree  of 
persistence  impossible  of  the  true  noise/reverberation  sources. 
Particularly  during  peacetime  operations,  these  false  contact 
sources  greatly  outnumber  actual  submarine  contacts.  The  re¬ 
sults  of  the  attitude  survey,  the  detection  experiment,  and 
specific  anecdotal  evidence  collec^'ed  from  the  survey  respon¬ 
dents  indicate  that  the  per.cetime  "solution"  >.c  this  consider¬ 
able  incidence  of  false  targets  consists  of  a  "low  detection 
efficiency,  strict  reporting  threshold"  mode  of  operation, 
brought  about  largely  by  the  typically  low  level  of  command 
attention  focused  upon  the  sonarman's  peacetime  role.  The 
consequence  of  this  mode  of  operation  is  to  screen  out  false 
(and  valid)  contac  at  the  lowest  hierarchical  level,  re¬ 

lieving  the  rest  o*  he  team  (CIC,  UB,  and  Command)  of  the 
burden  and  the  experience  of  the  ASW  decision-making  process. 

In  the  event  of  war  involv'ing  ASW,  however,  that  burden 
is  going  to  shift.  The  high  level  of  command  attention  which 
will  undoubtedly  be  focused  upon  the  ASW  role,  and  the  presence 
of  an  actual  threat  situation,  will  lead  to  a  "high  detection 
efficiency,  low  reporting  threshold"  mode  of  operation.  And 
this  is  a  desirable  and  probably  optimum  mode  of  operation, 
for  it  opens  the  channel  from  the  primary  ASW  sensor  to  the 
entire  ASW  team,  permitting  classification  and  attack  decision 
making  to  function  with  all  the  resources  that  can  be  brought 
to  bear  by  the  individual  surface  ship,  including  inputs  other 
than  sonar.  The  difficulty,  as  we  see  it,  lies  with  maintaining 


this  optisun  state  for  destroyer  ASW  operations.  At  the  onset 
of  war,  the  naturally  large  number  of  objects  which  can  cause 
false  contacts,  the  greater  wartime  inclination  for  the  sonar¬ 
man  to  detect  and  report  them,  and  the  inexperience  of  the  rest 
of  the  team  in  dealing  with  them  (and  their  heterogeneous 
attitudes  toward  them)  will  constitute  a  serious  ASK  decision 
problem.  The  seriousness  of  the  aatrer  is  heightened  by  the 
typical  peacetime  conduct  of  destrryer  operations,  which  often 
denies  the  -ASK  team  the  experience  of  reporting  and  prosecuting 
the  false  contacts  which  do  exist  in  the  ocean  medium,  in  peace 
or  war. 

Ke  fear  that  unless  destroyer  officer  personnel  appreciate 
the  false  contact  problem  in  its  fullest  extent,  apparent  com¬ 
mand  dissatisfaction  with  classification  performance  during  the 
transition  to  a  genuine  ASK  role  will,  intentionally  or  unin¬ 
tentionally,  influence  the  sonar  operator  in  the  direction  of 
undesirably  conservative  detection  and  reporting  behavior. 

And  it  is  a  discouraging  fact  that  very  cany  destroyer  command¬ 
ing  officers  have  been  provided  with  very  little  .ASK  training 
or  practical  experience. 

Ke  see  the  destroyer  commanding  officer  as  the  key  deter¬ 
miner  of  .ASK  teas  decision-making  behavior  during  the  transi¬ 
tion  to  a  wartime  ASK  role.  Research  under  this  contract  is 
now  focusing  on  the  destroyer  officer's  probable  responses  to 
wartime  .ASK  decision  situations- 
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The  Problem 

It  is  necessary  for  the  Navy  to  aake  quantitative, 
detailed,  and  accurate  estisates  of  expected  perforsaace  in 
a  vide  range  of  threat  situations,  and  particularly  in  acco*- 
plishlng  its  potential  vartiae  aissioas.  The  perforaance  of 
active  sonar  systess  is  critical  to  aany  of  those  aissions, 
so  it  is  essential  that  objective  procedures  for  predicting 
the  perforaance  of  sonar  systeas  vith  aan  in  the  loop  be 
developed.  It  is  also  necessary  to  develop  sufficient  under¬ 
standing  to  perait  aodification  and  optiaization  of  that  per¬ 
foraance  where  it  is  fo.iad  to  be  inadequate  or  non-optiaua. 

The  performance  of  an  active  sonar  system  is  greatly 
dependent  upon  the  behavior  of  the  sonar  operator  as  well  as 
upon  the  functioning  of  electronic  circuitry-  The  latter  is 
coEparatively  vell-knovn  and  deterministic .  However,  even 
the  most  sophisticated  contasporary  sonar  eqaipaent  essen¬ 
tially  only  prepares  inforaation  for  a  far  more  co»plcx 
processing  step:  the  operator's  detection  decision.  If  this 
decision  were  not  so  complex,  we  would  require  the  eqaipaent 
itself  to  make  it.  Because  this  processing  step  is  not  de¬ 
scribed  in  any  electronic  blueprint,  it  has  not  traditionally 
been  a  candidate  for  quantitative  analysis  and  predictive  syn¬ 
thesis.  Determination  of  detection  perforaance  has  previously 
taken  into  account  the  physical  characteristics  of  the  signal, 
noise,  and  reverberation,  but  little  attention  has  been  given 
to  the  influence  of  situational  variables  upon  the  operator *8 
detection  behavior  and  the  consequent  effects  on  sonar  per¬ 
formance  predictions. 

A  precise  definition  of  "detection"  is,  of  course, 
essential.  Because  of  the  complexity  of  the  active  sonar 


target  detect ion/ reporting  task,  sore  than  one  definition 
sight  be  possible.  One  frequently  hears  a  distinction  aade 
between  "detection"  and  "reporting" — the  report  of  sonar  to 
the  bridge  that  a  target  has  been  "detected."  It  is  also 
frequently  heard  that  an  operator's  "reporting  criterion”  is 
higher  than  his  "detection  criterion,"  so  that  he  does  net 
report  all  that  he  "detects."  Ithile  these  observations  in¬ 
dicate  that  "detection"  night  be  defined  separately  froB 
"reporting,"  they  also  reflect  awareness  of,  and  concern  for, 
an  important  fact:  that  sonar  operators  "filter"  inforsation 
in  transaittiag  it  froB  the  sensor  to  those  in  eoaaand.  The 
exact  nature  of  such  "filtering"  has  not  been  quantitatively 
known. 

Such  uncertainty  is  causa  for  concern,  since  tie  of 
TezsoTtins  s  santset  aonstitutss  the  OKlzt  oveTst-ionstl^ 
nif-issnt  vf  “detessiffn,  la  the  absence  of  such  a 

report,  a  ship  has  not  sade  a  "detection,"  and  cannot  react 
appropriately ,  regardless  of  the  state  of  Bind  of  a  sonar 
operator.  In  order  to  best  estiaate  expected  perforaance  of 
the  Navy  in  facing  any  ASW  situation,  operator  Teporting  be¬ 
havior  sust  be  known  for  that  situation.  Often,  detection 
perforsance  has  been  evaluated  in  experisental  situations  in 
which  no  atteapt  was  sade  to  relate  the  operator's  "experi- 
Bental  detection  criterion"  to  the  criterion  he  would  use  for 
sonar  contact  repoTting  during  operational  situations.  The 
"recognition  differential"  detersined  by  such  an  experisent 
say  be  useful  in  Baking  equipment  perforaance  cosparisons, 
but  it  bears  an  uncertain  relationship  to  the  expected  per¬ 
foraance  of  a  ship  in  facing  an  ASW  threat.  Knowledge  of 
reporting  behavior  necessarily  encompasses  intermediary  de¬ 
tection  behavior,  but  the  converse  is  certainly  not  true. 

It  has  been  the  basic  objective  of  the  research  described  in 
this  report  to  be  concerned  with  sonarmen's  target  reporting 
behavior  and  the  influence  of  the  operational  milieu  upon  it. 
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The  Approach 

Our  approach  to  understanding  the  sonar  reporting  decision 
has  been  guided  by  statistical  decision  theory.  Statistical 
decision  theory  provides  nor'sative  sodels  for  decision  saking. 
Khen  various  decision  paraaeters  and  explicit  decision  goals 
are  specified,  the  theory  prescribes  eatheaatically  nptiaua 
procedures  for  decision  Baking.  The  subset  of  the  aathe- 
aatical  theory  dealing  vith  binary  decisions  (typically,  the 
decision  concerning  the  presence  or  absence  of  a  signal  in 
noise)  has  been  particularly  *eli  developed  in  the  context  of 
electrical  coanunication.  Subsequently,  the  "theory  of  signal 
detectability"  has  cose  into  vide  use  as  a  aath&Batical  uodel 
for  the  hnnan  as  a  detector  in  psychophysical  tasks.  While 
the  appropriateness  of  the  assuuptions  necessary  to  make  this 
application  are  not  without  controversy,  the  approach  has 
rendered  the  singular,  isicout rovers ial  contribution  of  drawing 
well-deserved  attention  to  previously  neglected  aspects  of 
hu»an  detection  perforsance:  the  "false  aiara"  error;  the 
influence  of  signal  probabilities;  and  the  influence  of  sub¬ 
jective  costs  (or  values}  of  various  decision  outcoees.  There 
is  now  a  large  literature  reflecting  great  attention  to  these 
aspects  of  decision  Baking  for  psychophysical  detection  tasks. 
Green  and  Swets  (1965)  give  an  excellent  introduction  to  the 
application  of  signal  detection  theory  to  psychophysics; 
Jeffress  (1969)  discusses  these  natters  in  the  context  of 
sonar  detection. 

However,  aost  laboratory  psychophysical  tasks,  while 
bearing  soaewhat  questionable  relationships  to  the  underlying 
assuaptions  of  the  couBon  signal  detection  theory  aodel, 
because  of  their  coaplexity,  are  themselves  siaplistic  com¬ 
pared  to  aost  "real-world"  detection  tasks.  Two  things  in 
particular  distinguish  the  sonar  detection  task  fros  coaaon 
psychophysical  tasks:  its  "vigilance"  aspect;  and  its  "se¬ 
quential"  nature,  in  the  psychophysical  task,  the  "basic  huaan 


perceptual  sechaniss"  is  usually  the  principal  object  of  study, 
and  it  is  usually  the  desire  to  have  experiaental  results  un- 
confounded  with  the  effects  of  low  signal  probability,  varying 
degrees  of  arousal  and  notivation,  prolonged  work  periods,  and 
other  sources  of  variation  inherent  in  the  typical  operational 
task  of  searching  for  infrequent,  difficult-to-detect  signals 
over  relatively  long  periods  of  tiae.  The  presence  of  these 
effects,  organic  to  the  sonar  detection  situation,  strain  the 
assuaptions  underlying  the  application  of  the  aost  coaaon 
signal  detection  theory  aodel  (i.e.,  that  which  assunes  equal- 
variance  Gaussian  noise  and  signal-plus-noise  distributions) . 
For  a  discussion  of  the  application  of  this  aodel  to  vigilance 
tasks,  see  Broadbent  (1971). 

Further  coapli'^ating  the  application  of  the  simple  aodel 
is  the  sequential  njjxura  of  the  sonar  detection  task.  The 
sonar  operator  is  not  prcstntcd  with  clearly  defined  "op¬ 
portunity”  in  which  he  aust  respond  either  positively  or 
negatively  regarding  the  presence  of  a  signal;  rather,  the 
situation  is  one  in  which  he  aay  either  decide  to  report  a 
contact,  or  to  gather  aore  infcraation.  Indeed,  this  par¬ 
ticular  situation  even  omits  one  of  the  alternatives  of  Wald's 
sequential  decision  aodel  (Wald,  1947),  in  that  no  "rejection" 
decision  is  aade  overtly;  the  operator  either  reports,  or 
continues  observing-  Birdsall  and  Roberts  (1965)  recently 
have  theoretically  extended  Wald's  sequential  analysis  to  in¬ 
clude  costs  and  probabilities,  producing  what  nay  be  the  most 
appropriate  fabric  for  a  aodel  of  sonar  contact  reporting; 
however,  this  application  has  not  yet  been  attempted. 

If  a  precise  yet  satisfactory  theoretical  description 
of  a  task  as  cosplex  as  sonar  detection  is  wanting,  however, 
a  aore  general  but  valuable  insight  froa  statistical  decision 
theory  is  not,  for  the  theory  directs  our  attention  toward 
the  potentially  important  variables  of  the  decision-aaking 
process-  These  variables  are  listed  below  in  the  context  of 
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the  sonar  reporting  decision. 

1.  Contact  vevoTt-ing  cirttevton  ov  thveshold:  it 
is  postulated  that  a  sonar  contact  is  reported 
only  when  confidence  in  that  contact,  forsu- 
lated  froa  observation  of  the  sonar  displays, 
exceeds  a  "reporting  threshold,"  which  itself 
is  a  function  of  the  other  decision  variables, 
listed  below. 

2.  Missed  contact  consequences:  the  perceived  con¬ 
sequences,  or  "cost,"  of  an  error  of  osission. 

3.  False  contact  consequences:  the  perceived  con¬ 
sequences,  or  "cost,"  of  an  error  of  coaaission. 

Likelihood  of  making  contact:  the  subjective 
a  priori  probability  of  a  valid  sonar  contact. 

5.  ^Cost”  of  additional  observations:  the  per¬ 
ceived  conse! aences  of  delaying  sonar  contact 
reporting,  tc  obtain  additional  inforaation. 

Two  other  variables  of  the  general  decision  situation  were 
felt  inappropriate  to  the  sonar  contact  reporting  task.  These 
are  the  "values"  of  the  correct  outcoses  of  the  detection  de¬ 
cision:  "correct  detection,"  and  "valid  rejection."  It  was 
found  through  pilot  survey  work  that  the  "value"  of  a  correct 
detection  was  a  difficult  concept  for  the  sonar  operators  to 
evaluate;  and  the  valid  rejection  is  not  appropriate  because 
It  is  accompanied  by  no  overt  response  fros  the  sonar  operator 
(assuming,  of  course,  that  the  contact  has  not  already  been 
reported) . 

Theory  (and  couson  sense)  suggests  that  variables  1  through 
5  are  isportant  decision-aaking  variables.  As  applied  to  human 
decision  Baking,  these  variables  nay  be  regarded  as  constituting 
■psychological  dimensions ,  and  subjective  values  on  these  diaen- 
sions  for  a  given  decision  situation  may  influence  decision 
Baking.  The  first  objective  of  this  research  was  to  conduct  an 
attitude  survey  and  apply  psycfcoaetric  scaling  eethods  to  dc- 
tersine  how  Tealistic  tactical  scenarios  are  evaluated  on  these 
diaensions  by  the  decision  makers  themselves — a  representative 
sa^le  of  destroyer  sonar  operators. 
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In  addition,  the  evaluation  of  the  scenarios  by  destroyer 
officers  was  desired.  This  vies  motivated  by  the  fact  that  the 
theoretical  detector  can  only  be  said  to  be  "optimum"  with 
respect  to  the  given  consequences  and  a  priori  probabilities. 
The  determination  of  those  consequences  and  probabilities  is 
outside  the  scope  of  optimum  detection  theory.  Therefore, 
even  if  the  sonar  operator  behaved  precisely  as  an  ideal  de¬ 
tector,  that  behavior  would  only  be  optimum  for  the  decision 
variable  values  o.s  he  perceives  them.  Nothing  guarantees 
that  his  evaluation  of  an  operational  situation,  in  terms  of 
consequences  and  p 'obabi lities ,  is  "optimum"  in  any  sense. 

A  definition  of  optimality  for  ther  variables  would,  indeed, 
be  an  elusive  thing.  However,  it  is  in  part  the  judgment  of 
just  such  elusive  things  as  the  consequences  of  missed  de¬ 
tections  and  false  alarms ,  and  of  the  probability  of  meeting 
one's  adversary,  which  characterize  the  responsibilities  of 
command.  Thus,  the  survey  was  designed  to  include  a  repre¬ 
sentative  sample  of  destroyer  officers,  as  well  as  sonar 
operators,  to  permit  comparisons  between  these  groups.  The 
survey  method,  procedure,  and  results  are  described  in  detail 
in  the  next  chapter. 

Scaling  realistic  tactical  scenarios  in  a  psychological 
decision-variable  space  was  expected  to  result  in  a  unique 
and  valuable  contribution  to  understanding  the  nature  of  the 
important  theoretical  decision  variables  for  the  specific, 
practical  task  of  sonar  contact  detection  and  reporting.  How¬ 
ever,  the  quantitative  influence  that  situational  variables 
exert  upon  actual  sonar  contact  reporting  behavior  cannot  be 
determined  solely  from  judgmental  data;  the  relationships  must 
be  verified  experimental ■/•  Many  laboratory  psychophysical 
detection  experiments  have  shown  that  specific  instructions  to 
subjects  regarding  their  reporting  criteria  can  influence 
those  criteria  significantly;  and  this  has  been  shown  for  a 
simulated  sonar  detection  task  as  well  (Kostoff  and  Montgomery, 
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1970).  Other  laboratory  experiments  have  investigated  the 
influence  of  situational  variables  on  signal  detection  and 
reporting  behavior  through  the  less  direct  technique  of  pro¬ 
viding  "payoff  matrices"  to  the  subjects,  explicitly  specify¬ 
ing  decision  outcome  "costs"  and  "values,"  often  involving 
small  monetary  rewards  (e.g.,  Killiges,  1971).  A  sonar  de¬ 
tection  experiment  has  also  been  conducted  employing  the 
"payoff  matrix"  technique  (Rizy,  1972).  These  studies  typi¬ 
cally  show  that  "payoff  matrices"  have  some  influence  on 
reporting  criteria  ("B"  in  the  usual  signal  detection  theory 
model)  and  none  on  detection  efficiency ,  or  signal  detect¬ 
ability  for  the  man-machine  combination  ("d’"  in  the  usual 
model)  . 

We  feel  that  "payoff  matrices,"  involving  either  monetary 
rewards  or  simply  abstract  incentives,  provide  very  poor  ap¬ 
proximations  to  the  motivating  forces  central  in  the  question 
of  "peacetime"  versus  "wartime"  sonar  contact  reporting  be¬ 
havior.  We  have  little  doubt  that  "reporting  thresholds"  can 
be  directly  influenced  by  specific  instructions,  but  we  sus¬ 
pect  that  the  apparent  invariance  of  "detection  efficiency" 
in  these  experiments  was  due  to  the  relative  impotence  of  the 
"payoff  matrices"  employed  as  experimental  variables.  While 
it  is  not  (humanely)  possible  to  reproduce  the  physical  threat 
accompanying  decision  making  in  war,  we  were  convinced  that  a 
sonar  detection  experiment  could  be  conducted  in  a  context 
genuinely  perceived  by  Navy  sonar  operators  to  be  of  great 
importance,  and  of  particular  relevance  to  their  principal 
occupational  task. 

Therefore,  the  second  objective  of  the  research  reported 
here  wa;>  to  conduct  a  sonar  detection  experiment  involving  a 
realistically  potent  variable,  which  we  have  called  "command 
attention."  The  method,  procedure,  and  results  of  this  ex¬ 
periment  are  described  in  detail  in  the  chapter  entitled  "The 
Detection  Experiment." 


7 


CHAPTER  II 


THE  Attitude  survey 

Method 

The  objective  of  the  survey  was  to  obtain  the  judgments 
of  Naval  officers  and  fleet  sonar  operators  regarding  the 
positions  of  several  tactical  scenarios  along  certain  psy¬ 
chological  dimensions  selected  for  their  relevance  to  the 
sonar  contact  reporting  decision.  Five  psychological  dimen¬ 
sions  were  selected,  and  17  tactical  scenarios  were  selected 
to  be  scaled  on  these  dimensions.  Because  of  the  relatively 
large  number  of  dimensions  and  scenarios,  the  method  of  rank 
ordering  was  selected  to  permit  obtaining  the  judgmental  data 
within  reasonable  time  constraints. 

The  scenarios,  ranking  instructions,  and  procedure  are 
described  in  the  next  sections.  The  psychometric  scaling 
methods  used  to  evaluate  the  resulting  judgmental  data  are 
described  in  the  "Scaling  Technique"  section,  and  the  derived 
scale  values  in  the  "Results"  section.  In  addition  to  the 
ranking  tasks  which  the  respondents  were  requested  to  perform, 
each  was  asked  to  complete  a  questionnaire  which  contained 
questions  concerning  the  respondent’s  background  and  view¬ 
points  related  to  sonar  contact  reporting.  The  biographical 
data  thus  obtained  are  discussed  in  the  "Respondents"  section, 
and  the  responses  to  the  sonar  contact  reporting  questions  are 
discussed  in  the  "Results"  section. 

Scenarios 

Seventeen  tactical  scenarios  were  written  for  use  as 
stimuli  for  the  survey.  Since  the  objective  of  the  survey 
was  to  obtain  judgments  which  would  have  the  closest  possible 
connection  to  actual  or  anticipated  operational  situations, 
our  principal  guideline  in  the  composition  of  these  scenarios 


was  to  depict  realistic  situations  representing  a  broad 
spectrum  of  decision  variables.  No  attempt  was  made  to  con¬ 
struct  scenarios  to  achieve  predetermined  levels  of  the 
various  decision  variables  in  all  possible  combinations. 
Stimuli  generated  in  this  way  may  be  of  academic  value  in 
investigating  decision  making,  but  treating  the  various  as¬ 
pects  of  tactical  situations  as  ‘independent  variables  very 
frequently  leads  to  unrealistic  scenarios ,  and  the  resulting 
judgmental  data  stand  in  a  questionable  relationship  to  ex¬ 
isting  or  anticipated  AS”'  missions.  Our  approach  was  to 
treat  decision-making  variables  as  dependent  functions  of 
the  specific  tactical  situation,  and  our  goal  was  to  deter¬ 
mine  the  subjective  values  of  these  variables,  as  judged  by 
the  potential  decision  makers  themselves,  for  operational 
situations  of  the  greatest  practical  interest. 

Each  of  the  17  scenarios  is  shown  in  Appendix  A  exactly 
as  it  was  presented  to  the  survey  respondents  on  individual 
3'*  X  5”  cards.  The  scenarios  are  numbered,  and  listed  in  nu¬ 
merical  order,  but  the  numbers  were  assigned  to  the  scenarios 
randomly . 

Ranking  Instructions 

Each  respondent  in  the  survey  sample  was  asked  to  rank 
order  the  17  scenarios  five  times,  once  according  to  each  of 
the  five  sets  of  ranking  instructions.  Each  set  of  instruc¬ 
tions  was  designed  to  direct  their  attention  toward  a  par¬ 
ticular  aspect  of  the  sonar  detection/reporting  decision. 

The  rationale  for  each  of  these  sets  of  instructions,  and  the 
instructions  themseives,  will  be  given  in  turn.  There  exist 
slight  differences  between  the  instructions  given  to  officers 
and  to  sonar  operators.  The  instructions  shown  below  are  the 
operators’  versions;  the  complete  sets  of  instructions  for 
both  officers  and  operators  are  given  in  Appendix  B. 

Sonar  Contact  Reporting:  The  first  set  of  instructions 
given  to  each  respondent  directed  his  attention  toward  the 
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confidence  level,  or  degree  of  certainty,  felt  necessary  in 
order  to  make  a  sonar  contact  repo^’t.  Presumably,  the  re¬ 
porting  dncisioii  involves  weighing  the  physical  evidence  of 
a  contact,  as  displayed  by  the  sonar,  against  some  confi¬ 
dence-level  criterion  for  reporting.  In  the  usual  decision- 
theoretic  model,  the  result  of  observation  is  expressed  as 
some  monoconic  function  of  the  likelihood  ratio,  which  is 
then  compared  to  a  criterion  derived  from  decision  goal  con¬ 
siderations,  generally  involving  probabilities  and  decision 
consequences,  to  arrive  at  a  decision.  The  intent  of  the 
first  set  of  ranking  instructions  was  to  cause  the  respondents 
to  evaluate  and  compare  the  decision  criteria  (analogous  to 
those  of  the  decision- theoretic  model)  which  they  felt  they 
would  employ  in  the  various  scenarios. 

SO.VAR  CONTACT  REPORTING 

For  the  purposes  of  this  part,  please  imagine  that  you 
are  standing  a  sonar  watch  aboard  your  ship,  that  you  art  di¬ 
rectly  operating  and  observing  your  sonar,  and  that  you  ana 
you  alone  will  make  the  decision  to  report  sonar  detections 
to  the  bridge.  Your  certainty  of  a  contact  depends  on  many 
things,  such  as  echo  quality,  consistency,  strength,  and  so 
on,  and  you  can  be  more  sure  of  some  contacts  than  others. 

If  you  were  to  see/hear  a  very  strong  echo  which  shewed 
obvious  submarine  target  cues  or  characteristics,  you  could 
report  ’’possible  sub"  to  the  bridge  with  little  doubt  or 
uncertainty  concerning  the  contact.  On  the  other  hand,  if 
you  were  to  see/hear  an  ’’echo"  which  was  very  weak,  incon¬ 
sistent,  and  lacking  in  cues,  you  sight  not  be  sure  tJiat 
you  actually  have  a  contact.  Your  decision  to  report  such 
a  questionable  "contact"  to  the  bridge  sight  depend  upon  the 
operational  situation- -for  exanple,  you  sight  be  core  likely 
to  report  sucii  contacts  during  wartime  ASK  operations  than 
you  would  in  non-ASK  peacetioe  situations.  Please  carefully 
read  and  consider  each  of  the  situations  described  on  the 
cards,  and  place  the  cards  in  rank  order  in  front  of  you  so 
that  the  situation  in  which  TOU  FEEL  70V  WOVLDS"T  SEED  TO 
BE  VEST  SUSS  OF  A  CONTACT  TO  SEFOST  ’’POSSIBLE  SVB"  TO  TBE 
BBISGS  is  at  the  top,  downward  situation-by-situation,  to 
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the  situation  for  which  lOU  UOULD  VABT  TO  SB  PSETTT  SUSE  OF 
A  COHTACT  TO  REPOST.  After  you  have  done  this,  please  write 
the  card  nuidjers  in  the  boxes  on  the  other  side  of  this  page 
in  the  order  you  have  placed  the  cards- 

Consequences  of  Missed  Contacts:  The  second  set  of  rank¬ 
ing  instructions  given  each  respondent  directed  his  attention 
toward  the  consequences  of  errors  of  omission,  or  what  are 
commonly  referred  to  in  statistics  as  "errors  of  the  second 
kind";  that  is,  the  consequences  of  missed  contacts - 

CONSEQUENCES  OF  HISSED  COOTACTS 

For  the  purposes  of  this  part,  please  inagine  that  you 
are  the  sonar  operator  and  that  a  ’’contact"  briefly  caught 
your  attention,  but  was  so  weak,  intemittent ,  and  lacking 
in  cues  that  you  had  little  confidence  that  it  actually  was 
a  contact  and  did  not  report  it  to  the  bridge  as  "possible 
submarine. "  At  least  part  of  the  tine,  such  contacts  could 
actually  be  caused  by  subiaarines.  If  it  were  actuallv  a  sub¬ 
marine,  it  is  a  missed  contact  situation,  which  can  have  a 
variety  of  consequences.  Your  ship  nay  lose  points  during  an 
exercise,  in  tine  of  war  your  ship  cr  those  in  coapany  nay 
be  torpedoed,  the  subnarine  nay  move  out  of  range  and  never 
re-appear-  with  its  existence  reaaining  unknown,  and  so  on. 

The  exact  consequences  of  a  missed  contact  nay  be  different 
for  different  people,  and  nay  depend  upon  the  particular 
operational  situation.  Please  -ineg-ine  that  you  have  actually 
aissed  a  contact.  Carefully  consider  what  the  consequences 
of  a  missed  contact  night  be  as  you  see  ir.ea  for  each  of  the 
operational  situations  described  on  the  cards,  and  place  the 
cards  in  rank  order  in  front  of  you  so  tliat  the  situation 
whose  missed  contact  consequences  are  HOST  SEVERE,  ROST  VS- 
DESI3A3LS,  and/or  RQST  URPIEASABT  to  you  is  at  the  top, 
downward  situation-by-situation  to  that  whose  aissed  contact 
cor  sequences  are  LEAST  SEVERE,  LEAST  UODESIRA3LS,  and/or 
LEAST  VSFLSA3AST.  After  you  have  done  this,  please  write  the 
card  numbers  in  the  boxes  on  the  ocher  side  of  this  page  in 
the  order  you  have  placed  the  cards. 

Consequences  of  FaZse  Contacts:  The  third  set  of  instruc¬ 
tions  directed  the  responde'^t '  s  attention  to  the  consequences 
of  errors  of  commission,  or  errors  of  the  "first  kind";  that 
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is,  to  ihe  consequences  of  false  contacts.  The  perceived 
conseque.’ces  of  errors  of  this  kind  were  expected  to  be  par¬ 
ticularly  interesting-  Operators  are  taught  to  "report 
everything,"  but  anecdotal  evidence  indicates  that  operators 
are  reluctant  to  commit  "false  contact"  errors,  at  least  in 
some  situations,  to  the  extent  of  significantly  affecting 
their  target  reporting  behavior- 

CCNSEQUENCES  OF  FALSE  CO.STACTS 

For  the  purposes  of  this  part,  please  imagine  that  you 
are  the  sonar  operator  and  that  you  have  reported  a  contact 
to  the  bridge  as  "possible  submarine."  At  least  part  of  the 
tine,  a  contact  reported  as  "possible  sub"  turns  out  to  be 
non-subnarine.  This  situation  constitutes  a  false  contact, 
and  can  have  a  variety  of  consequences .  Fuel  and/or  weapons 
nay  be  expended,  the  ship  cay  leave  a  position  in  a  screen 
unguarded,  the  ship's  captain  nay  have  to  be  awakened,  and 
so  on.  The  exact  consequences  of  a  false  contact  nay  be 
different  for  different  people,  and  nay  depend  upon  the 
particular  operational  situation.  ?lease  iaiagir.e  that  gou 
have  aetvallg  reported  a  false  contact.  Carefully  consider 
what  the  consequences  of  reporting  a  false  contact  might  be 
08  you  esc  thes  for  each  of  the  operational  situations 
described  on  the  cards,  and  place  the  cards  in  rank  order  in 
front  of  you  so  that  the  situation  whose  ?ALSS  CCSTACI  CCSSE- 
QVaECeS  VOUID  BE  HCS?  SEVERE,  .VOST  VSDESISASLS,  zr,d/or  HOST 
VSPIEASA3T  is  at  the  top,  downward  situation-by-situation 
to  that  whose  FALSE  COuTACT  C03SEQUEBCES  WOULD  SE  LEAST  SEVERE, 

LEAST  US3ESIRABLE,  and/or  LEAST  USFLEASABT.  After  you  have 
done  this,  please  write  the  card  nuabers  in  the  boxes  on  the 
other  side  of  this  page  in  the  order  you  have  placed  the 
cards. 

Likelihood  of  Making  Contact:  The  fourth  set  of  in¬ 
structions  directed  the  respondent’s  attention  to  the  a  priori 
probability  of  contact  for  each  of  the  scenarios.  Expectation 
or  subjective  prior  probability,  is  an  important  variable  in 
decision-theoretic  models  of  human  decision  making,  and  in 
actually  observed  decision  behavior,  and  was  expected  to  be  an 
important  variable  in  sonar  contact  reporting. 
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LISELIHCOD  OF  MAKING  CONTACT 


The  likelihood  of  actually  aaking  contact  with  a  suhsarine 
varies  froa  situation-to-situation.  Please  carefully  consid*^r 
each  of  the  situations  described  on  the  cards,  and  place  the 
cards  in  rank  order  in  front  of  you  so  that  the  situation  you 
judge  MOST  LIZSL7  TO  SESVLT  IS  SVaHABISS  COSTACT  DUSISG  OSS 
SOSAS  VATCa  is  at  the  top,  downward  situation-by-situation  to 
that  LSAST  LISSLl  TO  SSSVLT  IS  SUSSASISS  COSTACT  D03ISG  OSS 
SOSAS  SATC3.  After  you  have  done  this,  please  write  the  card 
lumbers  in  the  boxes  on  the  other  side  of  this  page  in  the 
order  you  have  placed  the  cards. 

Response  Time:  The  final  set  of  instructions  called 
attention  to  the  consequences  of  delay  in  sonar  contact  re¬ 
porting.  It  Has  expected  that  scaling  the  scenarios  according 
to  the  ioportance  of  response  time  would  provide  insight  re¬ 
garding  the  "cost  of  observation"  variable  which  is  important 
in  sequential  decision  situations,  including  the  sonar  contact 
reporting  task. 

RESPONSE  TI.ME 

A  quick  detection  and  report  to  tfte  bridge  nay  be  sore 
important  in  sone  situations  than  in  others.  Please  carefully 
consider  each  of  the  situations  described  on  the  cards  and 
place  the  cards  in  rank  order  in  front  or  you  so  that  the 
situation  for  which  DSLAIISC  COSTACT  P.SSOSTISG  WOULD  SE  W0S3T 
is  at  the  top,  downward  si:  .ion-by-situation  to  that  for 
which  DSLAIISC  COSTACT  SSPOStlSC  WOULD  3S  LEAST  BAD.  .After 
you  have  done  this,  please  write  the  card  nuabers  in  tl.e  boxes 
cn  the  other  side  of  this  page  in  the  order  you  have  placed 
the  cards. 

To  identify  any  problems  in  our  approach,  a  pilot  survey 
was  conducted  at  the  Fleet  ASK  School,  San  Diego,  involving 
ten  sonar  technicians  and  five  Naval  officers.  The  results 
of  this  pilot  survey  were  very  satisfactory,  leading  only  to 
minor  modifications  in  the  wording  of  the  instructions.  The 
instructions  we  have  just  described  are  those  of  the  final 
form,  used  in  the  main  attitude  survey. 


ProeeduTe 


During  June  and  July  of  1971,  project  personnel  visited 
the  ports  of  Norfolk,  Virginia;  Newport,  Rhode  Island;  Long 
Beach,  California;  and  San  Diego,  California-  A  total  of  25 
destroyers  and  destroyer  escorts  were  visited.  Prior  arrange- 
nents  had  been  laade  to  have  two  groups  assembled  for  interview 
on  each  ship,  with  the  compositions  shown  in  Table  1- 


TABLE 

t 

1 

OFFICER  AND  E?iLISTEB 

GROUP 

COMPOS ITI OH 

Officer  Group 

Enlisted  Group 

a.  Conimandi no  Officer 

a. 

Leading  Sonar  Tech- 

b.  Executive  Officer* 
Weapons  Officer, 

b. 

nician 

Three  Sonar  Hatch 

or  Operations 

Supervi sors 

Officer  (two  of 
the  three) 

c.  ASH  Officer 

The  officer  and  enlisted  groups  were  assembled  separatety 
(usually,  the  officer  group  was  interviewed  in  th-5  wardroom 
and  the  enlisted  group  on  the  enlisted  raessdeck) ,  but  inter¬ 
viewed  simultaneously  by  two  of  our  personnel. 

After  a  rather  general  introduction,  each  participant 
was  giv'en  a  shuffled  deck  of  scenarios,  the  "introduction" 
page  of  the  instructions,  and  the  "Sonar  Contact  Reporting" 
page.  The  introduction  (see  Appendix  B)  explained  the  gen¬ 
eral  nature  and  purpose  of  the  survey,  and  contained  a 
biographical  questionnaire  which  was  completed  by  each  sub¬ 
ject.  The  "Sonar  Contact  Reporting"  ranking  instructions 
have  been  described;  each  subject  performed  this  ranking 
first.  Sufficient  space  was  provided  tor  each  person  to  lay 
out  the  17  scenario  cards,  in  order  to  facilitate  the  ranking 
process.  When  the  ranking  was  completed,  the  scenario  numbers 


were  recorded  by  the  subjects  on  the  back  of  the  ranking  in¬ 
struction  sheets.  After  each  respondent  had  coopleted  the 
ranking  according  to  the  first  set  of  instructions,  the  in¬ 
structions  were  taken  from  him,  and  the  next  set  of  instruc¬ 
tions  and  a  reshuffled  deck  of  scenarios  was  given  him.  Thus, 
no  subject  was  able  to  make  direct  comparisons  among  either 
the  sets  of  instructions,  or  their  own  responses.  Each  sub¬ 
ject  was  given  the  ranking  instructions  in  the  following 
order:  Sonar  Contact  Reporting;  Consequences  of  Missed  Con¬ 
tacts;  Consequences  of  False  Contacts;  Likelihood  of  Making 
Contact;  and  Response  Time.  When  each  respondent  had  com¬ 
pleted  the  ranking  task,  he  was  given  a  short  questionnaire 
to  complete  concerning  destroyer  .4SW.  Approximately  two  hours 
were  allowed  to  perform  these  tasks,  which  was  sufficient  in 
most  cases. 

The  Respondents 

A  total  of  99  Naval  officers  and  119  fleet  sonar  opera¬ 
tors  were  included  in  the  main  survey  sample.  The  composition 
of  this  sample  is  shown  in  Table  2.  In  general,  considerable 
interest  in  the  survey  was  expressed  by  the  respondents,  and 
the  cooperation  we  received  was  very  satisfactory.  Several 
destroyer  commanding  officers  requested,  and  were  given,  sce¬ 
nario  decks  for  use  in  subsequent  discussions  of  the  various 
considerations  raised  by  the  survey. 
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TABLE  2 

COMPOSITION  OF  SURVEY  SAMPLE 


OFFICERS 
By  Rate/Rank: 


ENLISTED 
By  Rate/Rank: 


CDR 

18 

STCS 

2 

LCDR 

22 

STCM 

3 

LT 

29 

STC 

17 

LTJG 

19 

ST  1 

13 

ENS 

9 

STG  2 

54 

CHO  2 

_2 

STG  3 

28 

TOTAL 

99 

STG  SK 

_2 

TOTAL 

119 

Ficers  by 
llet: 

Enlisted  by 
Primary  Duties: 

CO 

19 

Div.  CFO 

10 

xo 

18 

Sonar  Spvr. 

14 

Ops 

18 

Sonar  Oper. 

34 

ASW 

22 

Sonar  Haint. 

46 

Weapons 

20 

F/C  Haint. 

15 

CIC 

1 

TOTAL 

119 

Engnr 

J_ 

TOTAL 

99 

The  Seatt-ng  Technique 

Mathematical  models  for  decision  making  involve  values, 
costs,  and  prior  probabilities  to  deduce  the  expected  value 
of  decision  outcomes,  and  to  identify  optimal  decision-making 
processes.  In  human  decision  making,  these  considerations 
of  costs  and  probabilities  may  also  be  taken  into  account, 
though  very  often  numerical  values  for  them  are  not  available 
to  the  decision  maker.  Even  when  numerical  values  are  avail¬ 
able,  hoKever,  their  impact  on  decision  making  may  depend  upon 
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the*  way  the  decision  laaker  perceives  thea.  It  seess  reason¬ 
able  (and  has  been  experimentally  deaonstrated  for  some 
decision  situations)  that  "subjective**  values,  costs,  and 
probabilities  are  inportant  in  kuaan  decision  Baking.  These 
subjective  values  are  not  necessarily  the  saae  as  those 
aeasured  on  any  objective  scale:  they  represent  values  on  a 
psychological  scale  as  judged  by  the  huaan  decision  aaker. 
Statistical  decision  theory  directs  our  attention  toward  the 
isportant  variables  of  the  rational  decision-aaking  process; 
However,  the  importance  of  these  variables  in  huaan  decision 
Baking  is  a  Batter  for  eapirical  verification. 

In  the  case  of  signal  detection,  including  the  sonar 
detection  process,  decision  theory  suggests  that  six  vari¬ 
ables  night  be  of  particular  influence:  the  "values"  of  the 
two  correct  decision  outcomes,  eOTTect  report  and  correct 
dismissal',  the  "costs"  of  the  incorrect  outcoaes,  false 
alarm  and  false  refection',  the  "cost"  of  additional  observe^ 
tions  (because  the  sonar  situation  is  a  sequential  process); 
and  the  a  priori  probability  for  the  presence  of  the  signal. 

We  postulate  that  every  tactical  situation,  including  the 
17  represented  by  our  scenarios,  has  some  value  on  a  psycho¬ 
logical  continuum  with  respect  to  each  one  of  these  considera¬ 
tions-  The  relationship  of  the  ranking  instructions  to  these 
considerations  has  bean  previously  explained;  the  objective 
of  the  survey  was  to  determine  where  the  17  scenarios  fell  on 
five  of  these  psychological  continue. 

How  can  one  deterainr  the  position  of  a  scenario  on  one 
of  these  psychological  disensions?  The  nost  obvious  way, 
perhaps,  is  the  "quantitative  judgnent"  acthod.  A  judge  (a 
Naval  officer  or  sonar  operator)  could  be  asked  to  estisate 
the  scale  value  of  each  scenario  along  each  psychological 
dimension;  or  to  cstisate  the  distance  between  pairs  of  sce¬ 
narios  on  these  dimensions;  or  to  Bake  ordinal  judgments 
concerning  distances  between  pairs  of  scenarios  (e.g.,  the 
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distance  fro®  "A"  to  "B”  is  greater  than  the  distance  iron 
**C"  to  "D")  .  Each  of  these  tasks  supposes  that  distances 
between  scenarios  can  be  judged.  This  nethod  requires  con¬ 
siderable  tise  and  thought  on  the  part  of  the  judges,  presum¬ 
ing  that  they  can  perforss  the  task  at  all.  Particularly  with 
the  present  task,  it  was  felt  that  the  judges  could  not  per¬ 
form  in  a  seaningful  way  with  this  sethod  in  any  reasonable 
aiaount  of  tiae. 

Another  approach  to  identifying  the  scale  values  of  the 
scenarios  on  the  psychological  continua,  one  which  requires 
less  of  the  judges  in  tiae  ^ nd  effort,  and  particularly  in 
the  assuaed  ability  to  nako  “distance"  judgments,  is  the 
"variability  judgsent"  aethod.  In  this  aethod,  each  judge 
is  asked  to  aake  only  ordinal  judgaents  concerning  scenario 
scale  values.  For  esapplt ,  he  could  be  asked,  "which  is 
greater  (with  respect  to  the  pertinent  property),  scenario 
*A*  or  scenario  or,  he  could  be  asked  to  place  the 

scenarios  in  rank  order  (with  respect  to  the  pertinent  prop¬ 
erty).  .Although  each  judge  uakes  only  ordinal  judgsents, 
distances  between  scenarios  nay  be  derived  fron  the  variability 
in  the  ordinal  judgsents  asong  judges,  based  upon  the  follow¬ 
ing  hypothesis:  when  two  scenarios  are  net  widely  separated 
on  a  psychological  continuua,  there  is  likely  to  be  less 
agreesent  regarding  their  order  (that  is,  which  is  greater) 
than  if  the  scenarios  arc  widely  separated.  The  assuuption 
is  that  the  relation  between  acree~snt  concerning  the  order 
of  two  scenarios  (aeasured,  for  esaaple,  by  the  proportion  of 
judges  forning  the  majority  opinion)  and  the  distance  between 
the  scenarios  on  the  psychological  centinuur  is  aoaotoaic. 
Therefore,  for  exaaple,  if  95>  of  the  judges  feel  that  "A"  is 
greater  than  "S,"  but  only  60%  feel  that  "C"  is  greater  than 
"0,"  the  iaplication  is  that  ".A"  and  "B"  are  further  apart  en 
the  psychological  continuus  (and,  therefore,  nors  easily 
distinguished)  than  "C"  and  "D-" 
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This  hypothesis  is  a  very  reasonable  one  and  is  widely 
accepted  as  a  rather  unrestrictive  assumption.  The  next  step 
necessary  in  the  conventional  method  of  scaling  from  varia¬ 
bility  in  ordinal  judgments  requires  a  somewhat  stronger 
assumption.  How,  exactly,  does  one  transform  variability  in 
the  ordinal  judgments  into  distance  on  the  psychological  con¬ 
tinuum.  The  first  assumption  asserts  that  this  trarsforraation 
is  monotonic;  but  what  is  the  exact  relationship?  A  widely 
used  mathematical  model  of  this  relationship  was  first  pre¬ 
sented  by  Thurstone  (Thurstone,  1927). 

Thurstone  postulated  that  ivhen  a  given  stimulus  (e.g., 
a  scenario)  is  presented  to  a  judge,  it  gives  rise  to  what 
he  called  a  "discriminal  process,"  represented  by  a  specific 
scale  value  on  the  psychological  continuum  of  interest;  that 
the  value  of  the  discriminal  process  resulting  from  a  single 
presentation  of  the  stimulus  is  a  random  variable  with  a 
normal,  or  Gaussian,  distribution;  and  'hat  the  mean  and  the 
standard  deviation  of  this  normal  distribution  are  to  be 
taken,  respectively,  as  the  scale  value  of  the  stimulus,  and 
its  discriminal  d.is'persion.  In  other  words,  at  each  presenta¬ 
tion  of  the  stimulus,  its  value  is  "judged"  along  the  pertinent 
dimension,  and  each  judgment  reflects  "error"  from  the  "true" 
scale  value,  an  "error"  which  is  normally  distributed  about 
the  "true"  value.  In  this  model,  no  attempt  whatever  is  made 
to  account  for  the  sources  of  this  dispersion,  in  physical, 
physiological,  or  psychological  specifics.  Such  specificity 
is  unnecessary  for  this  model;  on  the  contrary,  because  there 
are  certainly  many  sources  of  judgmental  error,  appeal  is 
made  to  the  central  limit  theorem  of  mathematical  statistics 
in  justifying  the  Gaussian  distribution  assumption.  In  any 
event,  the  model  is  just  that;  it  must  be  subjected  to  em¬ 
pirical  v'cri  ficr.tion . 

Now,  in  the  "variability  judgment"  method  of  scaling;  we 
do  not  deal  with  direct  estimates  of  scale  values,  but  rather 


with  variability  in  ordinal  judgment.  What  are  the  implica¬ 
tions  of  Thurstone's  model  for  these?  In  making  an  ordinal 
judgment  concerning  two  stimuli  "A"  and  "B,"  we  can  say  that 
the  judge  attends  to  the  instantaneous  difference  betueen  vke 
discriminal  processes  resulting  from  stimulus  "A"  and  stimulus 
"B."  If  this  discriminal  difference  is  positive  (subtracting 
"A"  from  "B") ,  stimulus  ”B"  is  judged  to  be  greater  than  the 
stimulus  "A";  and  vice  versa  if  the  difference  is  negative. 
Obviously,  since  the  discriminal  process  resulting  from  a 
particular  exposure  to  a  stimulus  is  a  random  variable,  the 
discriminal  difference  is  also  a  random  variable.  And, 
because  the  distributions  of  the  discriminal  processes  of 
both  stimuli  "A"  and  "B"  are  postulated  to  be  normal,  the 
distribution  of  the  discriminal  difference  is  itself  normal. 

We  can  most  conveniently  express  these  relationships  in 
mathematicaJ.  notation,  as  follov/s. 


Let  the  "discriminal  process"  arising  from  stimulus  "i" 
be  denoted  the  random  variable  "X^."  In  the  Thurstone 
judgment  model,  the  probability  distribution  of  "X^"  is 
assumed  to  be  normal,  and  thus  completely  defined  by  its  mean 
and  standard  deviation.  Let  the  mean  of  this 
denoted  by  "S^"  and  the  standard  deviation  by 
model  these  parameters  represent,  respective!} 
scale  value"  of  stimulus  "i,"  and  the  "discrii 
of  stimulus  "i."  Thus,  to  use  the  convenient 


discriminal  process  is  N(S.,a?). 

Now,  let  the  "discriminal  difference"  between  stimuli 

"i"  and  "j"  be  denoted  by  "A..."  By  definition.  A..  =  X.-X.. 

ij  '  ij  j  1 

Therefore,  since  X  is  a  normal  random  variable,  A  is  also  a 

normal  random  variable,  which,  by  the  convenient  properties 

of  the  normal  distribution  (we  assume  X.  and  X.  to  be  un- 
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correlated)  has  itself  the  normal  distribution  N(S.-S.,  a?+o?)  . 
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Let  the  mean  of  this  distribution,  ’’S.-S.,”  be  denoted  by 

31’ 

"D. .  the  "true  scale  difference"  between  the  stimuli  in 
the  Thurstone  judgment  model-  The  star.dard  deviation  of  the 
discriminal  difference  is  Co?-*-cf|) 


To  return  to  the  ordinal  judgment  concerning  stisuii  "A' 


and  "B,"  we  sav;  that  if  the  discriminal  difference  =  Xg-X^ 


was  positive  for  a  particular  observation,  or  judgment, 

stimulus  "8"  was  judged  to  be  greater  than  stimulus  "A."  h'hat 

is  the  probability  that  this  event  will  occur?  it  is  .he 

probability  that  the  event  v;iil  occur,  which  is  ea.-sily 

calculated,  since  L  is  normal  with  knoiifn  parameters-  JJincs 

A.p  is  NCD.-,  0^  +  0^)  -A'e  hnow  iTOm  the  croperties  of  the  normal 
Ad  AUAd 

distribution  that  the  random  variable  Z  -•  (A  , _ -1),  j,)  /  (ac+o^)  ^ 
is  N  (0 ,  1).  Because  tables  of  the  distribution  function  of 
this  random  variable  (the  normal  deviate,  or  standard  score) 
are  commonly  available,  it  will  be  con'^enient  to  ask  the 
question  "what  is  the  probability  that  6^g>0?"  in  terms  of  Z, 
as  follows. 


If: 

Z  =  (A 
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then  Pr[A^g>0]  =  Pr[Z>-D^g/ (o2+o2)^] 

=  Pr[Z<D_^g/(o2*o2)^3 


x^'here  z,_  =  D.  j,/(o2  +  o|)^.  Thus  we  see  that  the  orobabi  lity 
A  t>  A  tS  A  B  * 

that  stimulus  "B"  is  judged  greater  than  stimulus  "A”  is  just 
the  area  under  the  normal  curve  up  to  the  point  2.^g»  which  is 
a  standard  score  that  represents  the  "true  scale  difference" 
between  stimuli  "A"  and  "B"  in  units  of  the  standard  deviation 
of  the  discriminal  difference- 

Now,  we  wish  to  experimentally  derive  (from  ordinal 
judgments)  information  concerning  distances  between  scenarios. 
This  may  be  done  in  the  following  way.  When  stimulus  "i"  is 
compared  to  stimulus  "j"  by  each  of  N  judges,  the  experimental 
observable  is  the  proportion  "pjj"  of  judgments  assert¬ 

ing  that  stimulus  "j"  is  greater  than  stimulus  "i"  on  the 
psychological  scale  of  interest.  According  to  the  Thurstone 
model,  the  probability  of  deciding  "j>i"  for  one  judgment  is 
so  the  expected  number  of  such  decisions  in  N  judg¬ 
ments  is  N<>[z^^],  and,  therefore,  the  expected  proportion  of 

such  decisions  in  U  sudaments  is  N4rz..]/N  =  ■Jfz..].  We 

"  1 J  1 J 

regard  the  experimentally  observed  proportion  of  such  deci¬ 
sions  as  an  estimator  of  the  inatheniaticai ly  expected  proportion: 


p.  .  =  [z  -  -  ] 

Therefore,  we  may  estimate 
z.  -  =  riip. .] 

where  $  ^ (p)  gives  the  ordinate  (i.e.,  the  standard  score) 
corresponding  to  the  area  "p"  beneath  the  normal  curve. 

The  estimated  z..  for  each  pair  of  stimuli  represents 
an  estimate  of  the  "true  scale  difference,"  D. . ,  between 
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those  stimuli  sealed  hu  the  faetov  (o.^  +  o.^)^  the  standard 

^  ^  ^  3 

deviation  of  the  disaviminal  difference .  If  o,  =  o.  =  a  for 

j 

all  ‘'i"  and  "j  the  scale  ractor  becomes  v2o.  One  of  the 
common  simplifying  assumptions  in  employing  Thurstone’s  scal¬ 
ing  model  is  this  assumption  (that  tiie  discriminal  dispersions 
for  all  stimuli  are  equal),  making  the  standard  deviation  of 
the  discriminal  difference  identical  for  all  pairs.  If  this 
is  so,  Ke  may  construct  an  equal  interval  scale  by  placing 
the  scenarios  so  they  are  separated  by  the  experimentally 
determined  z-.,  and  be  assured,  for  examule,  that  if  scenario 
"A"  is  twice  as  far  from  scenario  "C”  as  is  scenario  *'B”  on 
the  scale  so  construct-'d ,  this  distance  relationship  also 
holds  on  the  psychological  scale  of  interest.  This  property, 
of  course,  defines  an  equal  interval  scale,  and  is  independent 
cf  the  selection  of  an  origin  and  unit  for  the  scale.  The 
origin  and  unit  of  the  scale  are  not  defined  hy  paired  com¬ 
parison  or  rank-ordering  .judgments ,  which  underlie  the  present 
technique,  and,  therefore,  miist  be  derived  from  other  consid¬ 
erations  (if  at  all).  This  is  actually  an  advantage  of  the 
technique  for  scaling  the  tactical  scenarios,  because  the 
selection  of  an  origin  and  objective  unit  for  "missed  contact 
consequences,"  for  example,  can  be  very  difficult  (and  very 
variable).  Thus,  any  scaling  method  based  upon  the  supposed 
ability  of  individual  Naval  officers  or  sonar  operators  to 
evaluate  "consequences"  on  an  absolute  scale  (i.e.,  a  ratio 
scale)  is  likely  to  be  unsuccessful.  Ihe  method  we  have 
employed,  however,  docs  provide  interval  scales  regarding  the 
psychological  dimensions  of  interest. 

The  "interval  scale"  property  of  the  scales  we  have 
derived  docs  I'cpemd  on  the  assumption  that  the  discriminal 
dispersions  of  all  the  stimuli  (scenarios)  are  approximately 
equal.  lie  cannot  verify  that  this  is  so  from  the  data,  but 
we  feci  the  assumption  is  warranted,  in  that  the  resulting 
scaling  nodc-l  provides  a  nses'ul  description  cf  the  judgmental 
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data  we  have  obtained.  Actually,  we  Vnow  that  another  assump¬ 
tion  implicit  in  the  Thurstone  technique,  that  the  "distances'* 
between  scenarios  can  be  represented  on  a  single  dimension, 
is  definitely  violated.  This  violation  is  not  to  be  regarded 
as  a  "fault"  of  the  data;  it  reflects  the  interesting  dis¬ 
covery  that  judgments  of  the  scenarios  with  respect  tc  the 
important  tactical  decision  variables  are  inherently  multi¬ 
dimensional.  This  is  discussed  under  the  section  "Multidimen¬ 
sional  Scaling."  Nonetheless,  we  feel  that  the  unidimensional 
scales  derived  by  the  Thurstone  technique  are  of  considerable 
practical  value  in  displaying  the  results  of  the  survey. 

We  now  turn  to  a  description  of  the  practical  application 
of  the  Thurstone  scaling  technique  to  the  scenario  ranking 
data.  When  a  judge  has  rank-ordered  the  scenarios,  it  is 
assumed  that  the  ordex>  of  any  pair  of  those  scenarios  fairly 
represents  his  judgment  of  them  at  the  time  he  performed  the 
ranking.  Thus,  each  rank-ordering  of  the  17  tactical  scenarios 
by  a  subject  is  assumed  to  represent  his  comparative  judgment 
regarding  the  17x16/2  =  136  possible  pairs  of  scenarios  with 
respect  to  the  decision  variable  of  interest.  (In  the  "paired 
comparison"  technique  which  is  sometimes  used,  each  of  these 
136  pairs  would  individually  be  presented  to  the  subject; 
however,  the  method  of  rank  ordering,  which  implicitly  pro¬ 
duces  the  same  information,  is  much  faster  to  administer.) 

Thus,  when  H  judges  have  rank-ordered  the  scenarios  according 
to  a  given  set  of  instructions,  the  experimenter  can  examine 
the  N  judgments  of  each  of  the  136  pairs  of  scenarios,  and 
form  the  proportion  "p^j"  referred  to  earlier,  representing 
the  proportion  of  the  H  subjects  who  judged  scenario  "j"  to 
be  greater  than  scenario  "i."  These  data  are  conveniently 
represented  in  a  proportion  matri:: ,  P,  shown  in  Figure  1. 

Note  that  the  diagonal  elements,  representing  the  com¬ 

parison  of  a  scenario  with  itself,  are  assigned  the  proportion 
0.5.  .Also  note  that  symmetric  elements  must  sura  to  unity 


(p.  .  +  p..  =  1),  so  half  the  eleniersts  are  redundant. 

Ke  nov/  turn  to  the  "distance'-  estimates-  Ke  have  seen 
that  $~^[n..l  is  an  estimate  of  the  distance  z.  .  betv.-een  sce- 

11  13 

narios  "i"  iid  "i"  (in  units  of  the  standard  deviation  of  the 
discriininal  difference).  Therefore,  we  perforin  the  transfor¬ 
mation  (i.e.,  determine  the  unit  normal  deviates  corresponding 
to  the  observed  proportions)  to  obtain  the  matrix  Z  shown  in 
Figure  2.  Because  of  the  properties  of  the  P  matrix,  the  di¬ 
agonal  elements  of  the  Z  matrix  are-  all  zero,  and  the  matrix 


is  skew-svmmetri c  (i.e.,  2..  =  -z..). 

13  31' 

Si'e  know  from  the  theoretical  discussion  of  the  Thurstone 

scaling  model  that  the  element  z. .  of  the  Z  matrix  is  an  esti- 
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mate  of  the  "distance"  between  scenarios  "i"  and  "j."  There¬ 
fore,  we  could  piece  the  scenarios  on  a  scale  using  the 
following  technique.  First,  assign  scenario  1  an  arbitrary 
location  on  the  scale.  Then,  place  scenario  2  a  distance 
z,  -  from  scenario  1  on  the  scale;  then  place  scenario  3  a 
distance  z_  .  from  scenario  2;  place  scenario  A  a  distance 
2,  ,  from  scenario  3;  and  so  on.  The  resulting  scale  \\'ould 
graphicaliy  represent  (within  a  linear  transformation)  an 
estimate  of  the  scenario  positions  on  the  psychological  dim¬ 
ension  of  interest. 


However,  this  technique  makes  poor  use  of  the  experimental 

data,  simply  because  not  all  are  used;  those  elements  z. .  for 

which  3  r  i-*-!  v:ould  not  be  employed.  In  the  above  technique, 

only  one  estimate  of  the  distance  between  scenarios  "i"  and 

"3"  is  made,  that  represented  by  the  element  t- - •  Yet,  other 

estimates  are  possible,  because  ve  can  consider  the  difference 

between  the  dissanae  estimates  from  scenario  ''i”  and  scenario 

"j"  to  some  third  scenario,  ”k,”  to  also  be  an  estimate  of 

the  distance  between  scenarios  "i”  and  "j. "  That  is,  z.,  - 

z.,  =  zl.,  where  the  "prime"  indicates  an  estimate  of  z... 

3  k  1 3  ’  ^  13 

For  the  present  case,  there  are  17  such  estimates  possible. 
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one  for  each  value  of  the  “referencfc  scenario."  (Khen 

k=j ,  we  have  z..  -  z..  =  z. .  -  0  =  z. .  .  the  only  estimate 

used  in  the  elementary  scaling  procedure  suggested  above; 

and  when  k=i,  we  have  z..  -  z..  =  0  -  z..  =  -z . .  ,  which  is 

11  ji  ji 

identical  to  z...) 

Thus,  the  experimental  data  contain  17  estimates  of  the 

distances  between  scenarios  1  and  2;  between  2  arid  3;  and  so 

on.  Because  of  exvevimental  error ^  not  all  these  estimates 

for  a  given  scenario  -pair  will  be  numerically  equal.  To 

obtain  the  "best"  estimate  of  the  distance  between  a  given 

pair  of  scenarios,  the  arithmetic  average  of  the  1?  estimates 

at  hand  naturally  suggests  itself.  Hosteller  (1951)  has 

show:-',  that  doing  this  will  provide  a  least-squares  estimate 

of  the  "true"  z...  Thus,  the  "best"  estimate,  z?.,  is  given 
1  j  13 


n  I 


z* .  = 

11 


^^ik"^jk^ 


But,  note  that  this  is  equivalent  to: 

17  17 

^3  17  ^ik  17  "jk 

which  is  just  the  difference  between  the  mean  values  of  the 
cells  in  columns  "i"  and  "j"  of  the  Z  matrix.  These  column 
means  are  shown  in  the  bottom  rov;  of  the  Z  matrix  illustrated 
in  Figure  2,  denoted  by  "z|." 

Thus 3  if  each  scenario ^  "i,"  is  placed  on  a  scale  at  the 
value  of  its  column  mean,  "t|,"  the  distances  between  the 
scenarios  in  the  resulting  graphical  presentation  constitute 
the  ’’best”  representation  of  the  scenario  positions  on  the 
psychological  dimension  of  interest,  within  a  linear  transfor¬ 
mation.  That  is,  the  distance  relationships  are  represented, 
but  the  origin  and  units  of  the  psychological  continuum  are 
not  defined.  The  origin  of  the  graphical  representation  will 
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be  at  the  mean  of  the  scale  values  of  the  17  scenarios  (as 
an  incidental  result  of  the  scaling  procedure) ,  and  the  unit 
will  be  the  standard  deviation  of  the  discriainal  difference. 

In  the  "Results”  sections  following,  the  scenario  scale 
positions  are  shown  graphically  as  derived  by  this  technique. 

Results:  SonaT  Contact  Reporting  Thresholds 

The  scale  values  derived  for  the  scenarios  on  the  "Sonar 
Contact  Reporting"  continuum  from  the  entire  survey  sample  are 
shown  in  Figure  3.  At  the  top,  corresponding  to  the  "freest" 
or  most  "aggressive"  reporting  criterion  (corresponding  to  the 
least  strict  value  of  likelihood-ratio  criterion)  we  find  the 
following  scenarios: 

3.  Wartime  screening  for  merchant  convoy 

11.  Wartime  screening  for  amphibious  task  group 
9.  Wartime  strike  group  operations 
16.  Wartime  hunter-killer  operations 

The  property  which  characterizes  these  scenarios  is  obvious: 
they  are  wartime  situations. 

The  next  group  of  scenarios  include  the  following: 

2.  Unidentified  contact,  datum  1  hour  old 
10.  Unidentified  contact,  datum  4  hours  old 

13.  Condition  III  steaming  in  the  Mediterranean 

These  scenarios  have  in  common  the  possibility  of  contact  with 
Soviet  submarines  in  international  waters. 

The  next  group  of  scenarios  include  the  following: 

7.  Opposed  sortie  ASW  exercise 

14.  High  valued  target,  ASW  screening  exercise 
6.  Annual  ASW'  competitive  exercise 

15.  ASW  type  training 

4.  ASW  refresher  training 

These  scenarios  all  represent  ASK  exercise  or  training  situations. 

The  last  distinct  group  of  scenarios  on  the  "Sonar  Contact 
Reporting"  continuum,  in  the  direction  of  a  "strict"  or  "con¬ 
servative"  contact  reporting  criterion  (corresponding  to  a 
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Figure  3. 


Sonar  contact  reporting  thresholds  for  17  tactical 
scenarios . 
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stringent  value  of  likelihood-ratio  criterion),  include  the 
following  scenarios: 

5.  Deployment  transit,  proceeding  overseas 
17.  Deployment  transit,  returning 
12-  Night  plane  guard  in  local  op  area 
1.  Hon-ASW  refresher  training 
8.  Routine  steaming  at  night  in  a  local  area 

Each  of  these  scenarios  involves  a  routine  peacetime  task  not 
primarily  connected  with  ASW. 

Thus ,  on  the  psychological  continuum  of  sonar  contact 
reporting,  we  have  a  complete  spectrum  of  reporting  criteria 
represented,  from  Scenario  8,  "routine  steaming  at  night  in  a 
local  area,"  during  which  considerable  contact  classification 
certainty  is  felt  necessary  to  cause  sonar  to  arouse  and  alert 
the  ship;  to  Scenario  3,  "escorting  a  merchant  convoy  in  the 
North  Atlantic  during  a  hot-wax  situation,"  in  which  very 
little  evidence  is  felt  necessary  to  cause  the  sonar  operator 
to  report.  The  positions  of  the  scenarios  on  this  axis  seem 
easily  understood,  and  are  in  accord  with  our  expectations. 

The  total  sample  of  respondents  was  broken  down  in  several 
ways  in  an  attempt  to  identify  significant  differences  between 
groups.  Officers'  scale  values  were  compared  to  sonar  opera¬ 
tors';  Atlantic  Fleet  respondents  were  compared  to  Pacific 
Fleet  respondents;  "junior"  (defined  as  less  than  four  years' 
service  for  enlisted  personnel  and  less  than  eight  years' 
service  for  officers)  were  compared  to  "senior"  personnel ;  and 
commanding  officers'  scale  values  were  compared  to  all  others. 
No  significant  differences  among  the  various  groups  \fere  noted. 
However,  there  -is  a  breakdown  which  identifies  significantly 
different  groups  along  this  continuum;  this  breakdown  will  be 
discussed  under  "False  Contact  Consequences." 

Resutts:  Missed  Contaat  Conseauences 

4 

The  scale  values  for  the  scenarios  on  the  "Missed  Contact 
Consequences"  continuum  as  derived  from  the  total  survey  sample 


axe  shown  in  Figure  4.  (No  differences  among  groups  were 
noted.)  The  order  of  the  scenarios  along  this  scale  is  sub¬ 
stantially  the  same  as  that  along  the  "Sonar  Contact  Re¬ 
porting"  scale,  but  the  naTtime  soenar-ios  are  significaii.  y 
further  removed  from  the  others,  in  the  direction  of  more 
severe  consequences.  This  is  not  surprising.  The  contact 
reporting  threshold  is  dependent  on  all  the  other  decision 
variables,  and  the  relatively  low  wartime  a  priori  probabil¬ 
ity  of  contact,  compared  to  the  ASW  exercise  situations, 
probably  acts  to  prevent  an  extreme  separation  of  the  war 
scenarios  from  the  others  on  the  "Sonar  Contact  Reporting 
Threshold"  scale.  However,  the  "Missed  Contact  Consequences" 
scale  only  involves  a  single  variable  of  the  reporting  deci¬ 
sion:  consequences  of  the  error  of  omission.  It  seems 

easy  to  understand  why,  on  this  scale,  the  scenarios  can  be 
classified  dichotonously :  war  and  peace. 

Results:  False  Contact  Consequences 

In  marked  contrast  to  the  other  scales,  the  results  for 
the  total  sample  in  the  scale  of  False  Contact  Consequences 
showed  little  meaningful  separation  of  the  scenarios  (this  is 
not  illustrated).  None  of  the  previously  mentioned  breakdowns 
(i.e.  ,  officer/enlisted,  .Atlantic/Pacific,  junior/senior, 
CO/other)  results  in  any  significant  separation  of  the  sce¬ 
narios,  either.  However,  by  direct  examination  of  individual 
answer  sheets,  it  was  observed  that  the  respondents  fell  into 
three  categories  which  were  previously  unsuspected.  Ke  shall 
refer  to  these  as  "Groups  I,  II,  and  III."  When  the  total 
sample  is  broken  into  Groups  i,  II,  and  III,  the  scaling  re¬ 
sults  were  as  shown  in  Figures  S,  6,  and  7.  Group  I,  composed 
of  51  officers  and  &S  operators  (approximately  55%  of  the 
total  sample),  ranked  the  vartime  scenarios  as  having  the  most 
severe  consequeuces  from  false  contacts.  The  resulting  scale 
for  Group  i  is  not  greatly  different  from  the  Missed  Contact 
Consequences  scale  for  the  entire  sample.  (See  Figure  5.) 
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Figure  4.  Position  of  17  tactical  scenarios  on  the  scale  of 
missed  contact  consequences. 
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Positions  of  17  tactical  scenarios  on  the  scale 
of  fclse  contact  consequences  as  fudoed  Jiy  "Group  !•’ 
subjects. 
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Group  II,  composed  of  26  officers  and  34  operators  (about 
28%  of  the  total  sample),  ranked  the  scenarios  oppositely; 
they  ranked  the  wartime  scenarios  as  having  the  least  severe 
consequences.  The  scale  values  for  Group  II  are  nearly  mirror 
images  of  those  for  Group  I;  the  Pearson  product-moment  cor¬ 
relation  coefficient  between  the  scale  values  for  Groups  I 
and  II  is  -0.97.  (See  Figure  6.) 

The  members  of  Group  III  are  characterized  by  unpredict¬ 
ability  in  their  placement  of  the  scenarios  in  rank  order; 
that  is,  they  are  likely  to  have  placed  one  wartime  situation 
towarJ  one  end  of  the  scale,  but  another  wartime  scenario 
toward  tpe  other  end.  The  rank  of  a  given  scenario,  however, 
was  not  consistent  among  the  judges  in  Group  III.  This,  of 
course,  indicates  that  the  members  of  Group  III  did  not  dis¬ 
tinguish  the  scenarios  with  respect  to  false  contact  conse¬ 
quences.  (See  Figure  7.)  This  group  consisted  cf  19  officers 
and  13  operators  (approximately  17%  of  the  sample). 

After  the  breakdown  of  the  sample  according  to  attitudes 
regarding  false  contact  consequences  was  discovered,  a  re- 
computation  of  scale  values  for  the  other  dimensions  was  per¬ 
formed  separately  for  Groups  I,  il,  and  III.  This  rcanalysis 
showed  that  false  contact  con  -quence  attitude?  had  no  sig¬ 
nificant  effect  on  the  scale  values  for  Missed  Contact  Con¬ 
sequences,  Subjective  Probability  of  Contact,  or  Delayed 
Contact  Reporting  Consequences.  This  indicates  that  the  other 
decision  variables  were  independent  of  attitudes  toward  false 
contact  consequences.  Hoi«ever,  false  contact  consequences 
would  certainly  be  expected  to  be  related  to  the  "degree  of 
confidence"  felt  necessary  for  reporting  sonar  contacts;  that, 
is,  to  the  setting  of  the  reporting  criterion.  This  is  pre¬ 
dicted  by  decision  theory,  and  certainly  is  intuitively 
compelling  as  well.  And,  indeed,  when  scale  values  on  the 
"Sonar  Contact  Reporting  Threshold"  continuum  were  recomputed 
separately  for  Groups  I  and  II,  a  significant  difference  was 
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Figure  7.  Positions  of  17  tactical  scenarios  on  ths  scale  cf 
false  contact  consequences  as  .judged  by  "Group  III" 
subjects. 


noted,  as  car.  be  seen  in  Figure  8-  Since  severe  false  contact 
consequences  should  induce  a  ^ore  cautious  reporting  crite¬ 
rion,  we  would  expect  the  wartise  scenarios  for  Group  I  to  be 
found  farther  down  on  the  scale  than  those  of  Group  II,  since 
Group  I  perceived  false  contact  consequences  to  be  worst  during 
war.  This  effect  is  seen  in  the  scaling  results.  Likewise, 
we  would  expect  the  routine  peacetiae  scenarios  for  Group  II 
to  be  farther  down  on  the  scale  than  those  of  Group  I,  since 
Group  II  perceived  false  contact  consequences  to  be  worst 
during  these  scenarios.  This  effect  is  also  seen.  These 
effects  arc  particularly  interesting  since  all  the  respondents 
perforaed  the  ranking  on  the  sonar  contact  reporting  continuus 
prior  to  ranking  according  to  false  contact  consequences,  or 
any  of  the  other  decision  variables.  Thus,  it  appears  that, 
without  their  being  explicitly  called  to  the  respondent's 
attention,  false  contact  consequences  were  weighed,  con¬ 
sciously  or  unconsciously ,  in  perforaing  the  ranking  according 
to  the  "sonar  contact  reporting"  instructions.  This  observa¬ 
tion  supports  the  expectation  that  the  subjective  values  of 
these  variables  are  influential  in  actual  sonar  contact  re¬ 
porting  behavior.  By  way  of  interpretation,  it  would  seen 
that  cesabers  of  Group  II  would  be  prone  to  a  much  greater 
shift  in  willingness  to  prosecute  an  unknown  contact  in  the 
eventuality  of  war  than  members  of  Group  I. 

Analysis  of  the  survey  data  showed  no  way  to  predict  the 
membership  of  Groups  I,  II,  or  III  on  the  basis  of  the  per¬ 
sonnel  data  collected.  No  group  had  a  membership  which  was 
characteristically  officer,  enlisted,  Atlantic  Fleet,  Pacific 
Fleet,  sore  experienced,  less  experienced,  or  composed  of 
ccmmafiding  officers.  It  follows  that  whatever  influences  the 
attitudes  of  Groups  I,  II,  and  ill  have  on  decision-making 
behavior  in  ASK  are  .cow  distributed  unpredictably*.  As  we 
have  Seen,  however,  it  is  possible  to  identify  these  atti¬ 
tudes  b)'  means  of  the  survey  technique;  and  it  is  probable 
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SCENARIOS  FOR  »HICH  KGS?  CZRTAISTT  NAS  JUDGED  .NECESSART  IN  ORDER  70  REPORT  A  SONAR  COSTACT 

Figure  8.  Sonar  contact  reporting  thresholds  for  two  groups 
separated  by  attitudes  toward  false  contacts. 
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that  these  views  can  be  modified  through  training  if  it  is 
found  to  be  desirable.  However,  the  question  of  the  relation¬ 
ship  of  these  attitudes  to  actual  decision-making  behavior 
first  must  be  answered.  This  question  will  be  considered  in 
the  "Experiiuent”  section  of  this  report. 

Results:  Subjective  Probability  of  Submarine  Contact 

The  scale  values  of  the  scenarios  along  the  "Subjective 
Probability  of  Making  Contact"  scale  derived  from  the  total 
sample  are  shown  in  Figure  9.  There  were  no  differences  in 
scale  values  assigned  among  any  of  the  identified  subgroups. 

It  is  obvious  that  these  scale  values  reflect  a  different 
property  of  the  tactical  scenarios  than  the  other  dimensions 
scaled  in  this  survey.  This  is  not  surprising  since,  among 
the  decision  variables,  prior  probability  stands  apart;  the 
other  variables  involve  "consequence"  considerations  which 
we  expect  to  be  interrelated,  but  which  have  little  to  do 
with  "subjective  likelihood  of  making  contact."  The  latter 
is  determined  principally  by  the  expected  deployment  pattern 
of  the  "target"  submarines.  Both  theoretically  and  practi¬ 
cally,  the  subjective  probability  dimension  can  be  expected 
to  be  orthogonal  to  the  "consequence"  dimensions. 

The  scenarios  fall  into  two  distinct  groups:  the  first 
including  the  exercise,  the  wartime,  and  the  unidentified 
contact  scenarios;  and  the  second,  in  the  direction  of  least 
likelihood  of  contact,  including  the  peacetime  non-ASW  sce¬ 
narios.  It  is  very  obvious  that  expectation  of  contact  during 
peacetime  nor.-ASK  operations  is  extremely  low.  This  general 
grouping  of  the  scenarios  was  expected;  but  it  is  of  interest 
that  the  wartime  scenarios  were  placed  as  high  on  the  scale 
as  they  were,  at  the  same  average  position  as  the  "unidenti¬ 
fied  contact"  scenarios,  and  quite  near  the  ASW  exercise 
situations . 
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Figure  9.  Positions  of  17  tactical  scenarios  on  the  scale  of 
"subjective  prcbability"  of  submarine  contact. 
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Results:  Consequences  of  Delayed  Contact  Reporting 

Figure  10  shows  the  results  of  scaling  the  rank  orderings 
according  to  the  "response  time"  set  of  instructions  for  the 
total  survey  sample.  It  can  be  seen  that  the  consequences  of 
delayed  contrct  reporting  were  evaluated  in  very  much  the  same 
way  as  the  consequences  of  missed  contacts,  shown  in  Figure  4. 
On  the  latter  scale,  there  is  a  more  distinct  differentiation 
of  the  "cold-war"  scenarios  from  the  "exercise"  scenarios, 
and  a  greater  separation  of  the  "wartime"  scenarios  from  the 
others,  which  seems  reasonable.  Nonetheless,  it  is  evident 
that  the  "consequence"  considerations  involved  in  missed  con¬ 
tacts,  false  contacts  (at  least  according  to  the  "Group  I" 
attitude}  ,  and  delayed  reporting  are  very  strongly  related, 
and  that  these  considerations  make  the  principal  contribution 
to  the  character  of  the  "sonar  contact  reporting  threshold" 
scale.  The  "threshold"  scale  differs  from  the  "consequence” 
scales  in  showing  a  less  extreme  separation  of  the  wartime 
scenarios  from  the  others,  which  can  be  attributed  to  the  in¬ 
fluence  of  the  "subject? ve  probability"  variable,  which  tends 
to  produce  a  "conservative"  shift  in  the  reporting  criterion 
for  the  (relatively)  less  probable  wartime  contacts,  and  an 
"aggressi’.'e"  shift  for  the  (relatively)  probable  exercise  and 
training  sonar  contacts.  The  separate  scaling  of  the  "report¬ 
ing  threshold"  data  by  Group  I/Ii  "false  contact  consequence" 
attitudes  (Figure  S)  also  reveals  a  significant  quantitative 
influence  upon  the  sonar  contact  reporting  thresholds,  but  no 
gross  qualitative  effect  (such  as  an  inversion  of  the  scale 
corresponding  to  the  inverted  Group  II  false  contact  conse¬ 
quence  scale). 

Thus,  it  may  be  concluded  that  the  situational  variable  of 
greatest  importance  in  determining  the  sonar  contact  reporting 
threshold  is  that  which  gives  rise  to  the  perceived  conse¬ 
quences  of  delayed  sonar  contact  reporting,  and  of  missed  con¬ 
tacts;  a  situational  variable  we  may  aptly  call  the  "threat." 
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Figure  10.  Positions  of  17  tactical  scenarios  on  the  scale  of 
consequences  of  delayed  contact  reporting. 


Multidimensional  Scaling 


In  the  Thurstone  scaling  technique  it  is  assumed  that  the 
psychological  "distances"  between  stimuli  nay  be  adequately 
represented  in  a  single  dimension;  that  is,  they  may  be  pie- 
sented  on  a  single  scale,  as  we  have  done.  However,  if  the 
aspect  of  the  stimuli  being  regarded  by  the  judges  is  in¬ 
herently  Bultidipensional ,  the  distances  between  stimuli  cannot 
be  truly  represented  on  a  one-dimensional  scale ^  Most  often, 
multidimensional  stimuli  are  regarded  as  being  representable 
by  points  in  Euclidean  space,  forming  a  simple  geometrical 
model  which  (at  least  up  to  5  dimensions)  is  analogous  to  the 
familiar  spatial  surroundings  in  which  we  perceive  ourselves. 
Then,  "distance"  between  points  has  its  familiar  meaning. 

Since  the  ranking  task  forces  each  judge  to  place  the 
stimuli  in  a  one-diraonsional  ordinal  arrangenent,  it  is  not 
immediately  evident  that  multidimensional  information  can  be 
recovered  from  rank-order  data.  Nonetheless,  it  can,  because 
of  the  variability  among  judges  concerning  the  precise  way  in 
which  each  forces  the  stimuli  onto  a  single  dimension.  T*-o 
same  basic  assumption  that  was  made  £ui  tne  Thurstone  tech¬ 
nique  is  made  for  t- .itidimensional  scaling:  that  the  rela¬ 
tionship  of  proportion  of  agpeement  among  judges  eoncevning 
too  stimuli  to  the  psyohologiaal  distance  between  the  stimuli 
is  monotonia. 

This  was  the  first  assumpti*  n  made  for  the  Thurstone 
technique;  it  was  necessary  to  make  another,  more  restrictive, 
assumption  (that  there  is  a  "discriminal  process"  with  a 
Gaussian  distribution)  to  obtain  actual  scale  values.  However, 
we  do  not  need  to  make  the  latter  assumption  for  the  multi¬ 
dimensional  scaling  technique  that  we  employed,  which  is  an 
advantage  of  the  technique.  Kc  need  only  the  assumption  that 
the  judged  "dissimilarities"  between  stimuli  (measured  by  the 
proportion  of  agreement  among  the  judges)  is  monotonical ly 
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related  to  the  ”distai*ces"  between  stiisuli  in  the  psychological 
space,  so  that  the  rank  order  of  the  "dissiailarities"  for  all 
pairs  of  stinuli  is  identical  with  the  rank  order  of  the 
"distances"  for  all  pairs  of  stisuli.  If  this  is  so,  then  a 
spatial  arrangeaent  of  the  stisuli  which  corresponds  to  the 
original  configuration  of  the  stinulus  positions  in  psycholog¬ 
ical  space  p-ai/  he  vsaoveved  the  rank  order  of  the  dis- 

s-irsiXariti.es  (except  for  a  possible  rotation,  translation, 
or  expansion,  which  does  not  affect  the  rank  order  of  the 
distances).  To  grasp  this  intuitively,  consider  a  collection 
of  Qany  objects  (for  exartple,  narblcs)  to  be  strewn  about  in 
Euclidean  two-space  (for  example,  the  floor  of  a  handball 
court).  tf  there  are  lots  of  aarbles,  you  can  readily  appre¬ 
ciate  the  fact  that  a  given  marble  can’t  be  moved  very  far  in 
any  direction  without  disturbing  the  rank  order  of  the  dis¬ 
tances  between  that  marble  and  all  the  others,  since,  as  it 
is  moved  closer  to  some,  it  will  be  moved  farther  frou  others. 
Thus,  the  specification  of  the  rank  order  of  the  distances 
from  the  given  narble  to  all  the  others  pretty  well  fixes  its 
position  on  the  floor  of  the  court.  i\nd,  since  the  "dissimi¬ 
larities"  are  assumed  to  be  in  the  same  rank  order  as  the 
distances,  the  rank  order  of  the  dissimilarities  also  fixes 
the  position  of  the  given  narble. 

You  can  also  appreciate  the  practical  difficulty  of  trying 
to  arrange  marbles  in  a  handball  court  to  satisfy  a  long  list 
of  rank-ordered  distances  or  dissimilarities  which  should  exist 
among  them.  This  very  cumbersome,  iterative  reconstruction, 
however,  can  be  handled  expeditiously  in  the  digital  computer. 
The  principles  and  practical  ispleacntation  of  this  technique 
were  first  given  by  Shepard  (1952aj  iS62b),  and  refined  by 
Kruskal  (1964a;  1954b);  and  we  have  used  a  computer  program 
(TORSCA)  prepared  by  Young  and  Torgerson  (1967)  to  accomplish 
the  necessary  manipulations. 


The  "dissiai larities"  used  by  the  prograa  were  derived 
froa  the  proportion  aatrix  (Figure  1).  and  the  prograa 
arranged  the  stimuli  (scenarios)  in  two  diaensions  so  that 
the  distances  between  the  scenarios  were  (as  closely  as  pos¬ 
sible)  in  the  saae  rank  order  as  the  judged  dissiailarit ies 
between  the  scenarios.  (Se  also  scaled  the  data  in  higher 
dimensions,  and  concluded  that  the  two-diaensional  solution 
is  aost  appropriate.) 

The  configurations  of  the  scenarios  derived  froa  the 
rankings  according  to  aisscd  contact  consequences  and  conse¬ 
quences  of  delayed  contact  reporting  are  shown  in  Figures  11 
and  12,  respectively.  The  wartime  scenarios  (5,  9,  11,  and 
16)  are  ositted  froa  these  figures,  because  their  extreme 
separation  froa  the  peacetise  scenarios  aasks  ti.a  interesting! 
relationships  among  the  latter,  if  the  coaputer  prograa  is 
forced  to  include  thes. 

It  is  evident  from  these  figures  that  a  second  dimension 
is  needed  to  completely  represent  the  judgcental  data.  It  is 
also  evident  that  the  horizontal  diaension,  labeled  "tactical 
consequence  of  error,"  corresponds  sost  strongly  to  the  single 
dimension  upon  which  the  scena.^'ics  were  scaled  by  the  Thurstone 
technique  (Figures  4  and  10),  that  is,  the  projections  of  the 
scenarios  onto  the  horizontal  dimensions  of  Figures  11  and  12 
lead  to  representations  very  similar  to  those  of  Figures  4  and 
10. 

Ifhat  is  represented  by  the  second  dimension  (the  vCitical 
axis)?  Ke  postulate  that  this  dimension  is  related  to  "personal 
consequence"  of  error.  In  the  case  of  the  ASM  exercise  and 
training  scenarios,  for  example,  we  see  that  the  "exercise" 
situations  are  distinctly  separated  from  the  "training"  situa¬ 
tions  on  the  vertical  dimension.  The  .ASK  exercise  situations 
have  an  "evaluative"  connotation  which  may  make  errors  of 
greater  "personal"  consequence  than  in  the  training  situations. 
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which  are  by  their  nature  more  tolerant  of  error.  Thus, 
perceived  "personal  consequence"  seems  to  increase  as  we  move- 
upward  on  the  vertical  axis. 

The  non-ASW  situations  appear  to  be  ordered  along  the 
vertical  dimension  by  what  we  will  call  "general  arousal  level" 
of  the  ship,  decreasing  as  we  go  up  the  scale.  In  the  "deploy¬ 
ment  transit,  proceeding  overseas"  there  would  be  a  general, 
high  level  of  arousal  throughout  the  ship;  diminishing,  as  we 
consider  the  scenarios  in  their  order  along  the  scale,  to 
"routine  steaming  at  night,"  in  which  most  cf  the  ship's  com¬ 
pany  is  asleep-  We  suggest  that  an  "error"  on  the  part  of 
the  sonar  operator  is  perceived  to  be  a  potentially  smaller 
perturbation  of  th  "status  quo"  when  the  ship  is  in  a  "high" 
arousal  state,  and  therefore  of  lesser  personal  consequence, 
than  an  error  committed  during  a  state  of  lowev  general 
arousal  (which,  in  the  extreme,  might  involve  waking  a  sleep¬ 
ing  ship's  company,  as  a  consequence  of  "over-eager"  contact 
reporting;  such  behavior  might  be  commended  by  the  conscientious 
commanding  officer,  but  we  are  led  to  believe  that  the  typical 
ship's  company  is  not  so  likely  to  offer  po.sitive  reinforcement 
of  this  behavior). 

The  "cold  war"  scenarios  (2,  10,  and  13)  are  not  consis¬ 
tently  ordered  on  the  "personal  consequence"  dimensions  between 
Figures  11  and  12,  We  attribute  this  to  experimental  error, 
owing  to  their  relatively  small  separation  on  the  vertical 
dimension.  A  similar  inconsistency  is  seen  for  scenarios  14, 

6,  and  7  between  Figures  ii  and  12;  these  scenarios  are  also 
very  close  together. 

The  discovery  of  the  "personal  consequence"  dimension 
does  not  significantly  alter  any  of  the  conclusions  drawn  from 
the  scaling  via  the  Thurstone  technique.  The  effect  o£  the 
separation  of  the  scenarios  in  this  second  psychological  dimen¬ 
sion,  when  the  scenarios  are  forced  onto  a  singl-e  scale  by  the 
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Thurstone  techsiique,  is  to  introduce  a  little  more  separation 
among  the  scenarios  of  a  group  (i.e.,  non-ASW;  exercise; 

"cold  war,"  wartime}  than  the  projections  of  the  two-dimensional 
scenario  positions  onto  the  "tactical  consequence"  axis  would 
show.  Thus,  the  scenarios  are  somewhat  more  tightly  "grouped" 
on  the  psychological  "tactical  consequence"  scale  than  the 
Thurstone  scaling  indicates.  The  unidimensional  representation 
remains  a  useful  one,  but  it  is  interesting  that  "personal 
consequences"  seen  to  play  an  identifiable  role  in  the  judgment 
of  decision  consequences. 

Questionnaire  Results 

In  addition  to  the  ranking  tasks,  each  survey  respondent 
was  asked  to  complete  a  questionnaire  designed  to  provide 
additional  information  concerning  viewpoints  related  to  sonar 
contact  reporting.  This  questionnaire  was  completed  at  the 
conclusion  of  the  ranking  tasks.  The  questions  are  reproduced 
in  this  section,  together  with  response  distributions  and 
interpretive  comments. 
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QUESTIOXNAIRE 

fOR  SACS  QUESTION,  CHECK  TEE  ORE  SESE0B3E  IBAT  MOST  ACCORATELY 
REFLECTS  I'OUR  CWB  OPIRIOU. 

1.  During  p-^esent-iay  non-ASV  peaceti-ne  operatioKS  (for  ex- 
asple,  peacetiise  transiting',  non-ASW  refresher  training, 
and  so  on),  which  do  you  feel  sonar  operators  should  do? 


Officer  Enlisted 

_8S 

ITS 

a. 

38S 

S2S 

b. 

Bt.i 

31S 

c. 

1  is  the 

only 

point 

ted  personnel 

di  f  fe 

Report  fewer  false  contacts  than 
they  do  now  even  though  it  aeans 
increased  delay  in  reporting. 

Continue  present  reporting 
practices - 

Report  contacts  core  quickly  than 
thay  do  now  even  though  it  neans 
sore  false  contacts. 


While  the  majority  of  officers  favored  "quicker"  reporting 
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during  routine  non-ASK  operations,  cne  ..ajority  cf  operators 
favored  ’’continuing  present  reporting  practices.” 

2.  During  ppsssr.t-dcy  AS'J  cseraiee  cituatCons,  vhich  do  you 
feel  sonar  operators  s'tutuld  do? 

6S  3.  Report  fewer  false  contacts  than  they  do  now 
even  though  it  ncans  increased  delay  in 
reporting- 

37^  b.  Continue  present  reporting  practiccs- 

S7t  c.  Report  contacts  saore  quickly  than  they  do  now 
even  though  it  ceans  core  false  contacts. 

In  Question  2,  officer  and  enlisted  personnel  are  in 
agreement:  the  majority  favors  "quicker"  reporting.  Since 
the  response  distribution  is  not  significantly  different 
from  the  officers’  responses  to  Question  1,  it  is  apparent 
that  the  enlisted  personnel  (as  a  gi'oup)  changed  their  posi¬ 
tion  in  responding  to  the  second  question.  The  responses  to 
these  two  questions  may  indicate  some  lack  of  communication 
from  the  officers  to  the  sonar  operators,  since  it  is  totally 
within  the  realm  of  these  two  groups  to  effect  "quicker" 
reporting  if  that  is  desired. 

3.  Which  have  you  found  to  be  true? 


LAWT  PAC 
36X  bSS 


32S  23S 


a.  Many  aorc  fajje  contacts  are  reported 
during  .ASK  exercises  than  during 
no«-ASK  peacciiae  operations. 


24S  20S 


c.  About  the  saao  nuaber  of  false  contacts 
are  reported  during  .ASK  exercises  and 
nen-ASK  peace: ice  operations. 

d.  Fewer  false  contacts  are  reported  during 
-ASK  exercises  than  during  non-.ASW  peace- 
tise  operations. 


Question  3  is  the  only  point  in  the  survey  at  which  the 
Atlantic  Fleet  and  Paci-’^ic  Fleet  personnel  differed  signifi¬ 
cantly  [PCx^)  <  *05],  with  the  latter  indicating  the  ratio 
of  .ASW  exercise  to  non-exercise  false  contact  rate  somewhat 
greater  than  the  .Atlantic  Fleet  experience.  .A  possible 
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explanation  for  this  difference  isay  be  differences  in  the 
"non-ASK  peacetime*’  environnencs  of  the  fleets:  the  Atlantic 
Fleet  has  a  higher  rate  of  contact  with  •’real'*  targets  than 
the  Pacific  Fleet,  reducing  somewhat  the  contrast  between 
•'exercise"  and  "non-exerciae"  conditions,  relative  to  the 
Pacifc  Fleet- 

Note  that  very  few  felt  that  the  same  false  contact 
rate  obtained  during  exercise  and  non-exercise  conditions. 

The  20-24%  who  responded  "fewer  false  contacts  during  exer¬ 
cises"  were  probably  thinking  oi  situations  in  which  knowl¬ 
edge  of  position  of  the  target,  or  actual  contact  with  it, 
decreased  attention  to  non-target  contacts.  The  large 
majority  who  responded  "aore"  or  "many  more"  false  contacts 
during  exercises  are  no  doubt  reflecting  the  effect  of  in¬ 
creased  expectancy  during  exercises,  resulting  in  increased 
false  alarm  rates. 

4.  Hov  such  of  a  problcz  do  ycu  think  false  con:acts  would  be 
in  the  event  of  a  war  invoiving  ASK? 


18;  a. 

Very  serious  problem. 

b. 

Serious  probles. 

43X  c. 

Moderate  problea. 

6;  d. 

Insignificant  problea. 

In  Question 

4,  the  majority  felt  that 

false  contacts 

would  constitute 

a  "serious"  or  "very  serious"  problem;  very 

few  felt  that  it 

would  be  "insignificant." 

No  difference  in 

response  pattern 

existed  between  groups. 

S.  At  the  present  tiae,  hov  veil  do  you  think 
judge  the  degree  of  certainty  vhich  sonar 
initial  fcntact? 

the  bridge  can 
has  about  an 

3;  a. 

Very  accurately. 

295  b. 

Accurately. 

58;  c. 

Not  very  accurately. 

105  d. 

N'ot  at  all. 
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6.  How  useful  do  you  think  knowledge  of  sonar's  confidence  or 
certainty  concerning  an  initial  contact  would  be  in  deci¬ 
sion  saking  on  the  bridge  during  a  war  involving  ASK? 

83£  a.  Very  useful. 

14*  b.  Moderately  useful. 

2*  c.  Of  little  use. 

IX  d.  Of  no  use. 

Questions  5  and  6  indicate  a  potentially  serious  ineffi¬ 
ciency  in  the  communication  of  useful  information  from  sonar 
to  command.  The  majority  of  both  officers  and  sonar  opera¬ 
tors  (with  no  significant  difference)  felt  that  sonar's 
"certainty"  judgments  were  "not  very  accurately"  perceived 
on  the  bridge;  yet  the  very  large  majority  of  officers  and 
operators  felt  such  information  would  be  "very  useful  in 
decision  making.  The  usefulness  of  such  information  in  dis¬ 
tinguishing  false  from  valid  contacts  was  substantiated  by 
the  detection  experiment  to  be  described. 

7.  Froa  your  ovn  eszerience  during  present-day  .ASK  exercises, 
what  do  you  feel* is  a  typical  false  contact  rate 

a.  in  coastal/shallov  water? 

_ per  _ 

nusber  of  false  co?itacts  unit  of  ti,s:e~ 

b.  in  nid-ocean/deep  water? 

_ per  _ 

nunber  of  false  contacts  unit  of  tine 

8.  In  the  event  of  var  involving  ASK,  what  do  you  feel  a 
typical  false  contact  rate  night  be 

a.  in  coastal/shallow  water? 

_ _ _ per  _ 

nuaser  oj  fatsc  contacts  unit  of  tise 

b.  in  Eid-ocean/deep  water? 

r.zczber  of  false  contacts  unit  of  tiae 

The  responses  to  Questions  7  and  S,  whose  formats  are 
shown  above,  are  depicted  for  the  total  sample  (there  were 
no  differences  between  groups)  in  Figure  15  in  the  form  of 
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histograms.  The  histograms  have  been  arranged  in  order  of 
increasing  estimates  of  false  alarm  rate  from  top  to  bottom; 
the  difference  between  the  distribution  of  responses  for 
Questions  7b  and  8b  is  very  significant  [P(x‘)  <<  .001}.  The 
difference  between  rld-ocean  and  coastal  estimates  is  partly 
due  to  differences  in  sonar  environment;  the  difference  be- 
tifeen  exercise  and  wartime  estimates  no  doubt  reflects  the 
expected  effects  of  wartime  decision  consequences  in  lowering 
the  detection/reporting  threshold. 

Questions  7  and  8  were  intended  more  to  measure  the 
opinions  of  the  personnel  sampled  than  to  project  actual 
false  alarm  rates;  but  if  these  opinions  proved  to  be  ac¬ 
curate,  it  is  obvious  that  wartime  false  contact  rate  would 
be  very  substantial  indeed,  posing  a  very  significant  attack 
decision  problem. 
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CHAPTER  III 


THE  DETECTION  EXPERIMENT 


Objective 

The  objective  of  the  detection  experiment  was  to  compare 
sonar  operator  detection  and  reporting  performance  under  two 
conditions  that  would  be  perceived  by  the  operators  as  having 
very  different  consequences  as  a  direct  function  of  their  per¬ 
formance-  The  problem  is  to  identify  controllable  variables 
associated  with  such  conditions.  Ideally,  one  would  like  to 
manipulate  perceived  threat  directly.  Even  with  ethical 
questions  aside,  it  is  doubtful  whether  this  can  ever  be  done 
while  maintaining  sufficient  experimental  control  to  make  the 
results  meaningful.  There  is  one  operationally  meaningful 
variable,  however,  that  relates  directly  to  perceived  impor¬ 
tance  of  the  tactical  situation  if  not  to  perceived  threat 
per  se.  That  variable  is  "command  attention. " 

Because  of  their  relative  isolation  from  command  and 
control  activities,  often  for  very  long  periods  of  time  during 
non-ASW  evolutions,  sonar  operators  appear  to  be  particularly 
responsive  to  communications  from  command  that  bear  upon  the 
importance  of  their  performance.  Such  communications  may 
occur  with  very  different  frequencies  as  a  function  of  the 
tactical  situation  and  individual  command  attitudes.  However, 
it  is  widely  assumed  in  the  Navy  that  high  levels  of  profi¬ 
ciency  among  ASlf  ships  are  typically  associated  with  high 
levels  of  "command  attention." 

It  seems  reasonable  to  assume  that,  in  general,  "command 
attention"  will  vary  with  the  tactical  situation;  it  will  be 
very  low  during  non-ASW  missions,  moderately  high  during  ASS 
competitive  exercises,  and  highest  of  all  in  the  event  of  a 
true  threat.  It  was  our  objective  to  set  up  two  very  different 
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situations  with  respect  to  the  evident  "conmaiid  attention" 
and  to  aeasure  the  resulting  differences  in  detection  and 
reporting  performance  by  typical  sonar  operators. 


We  felt  that  the  effect  of  "coomand  attention"  on  per¬ 
formance  could  manifest  itself  in  the  setting  of  the  reporting 
criterion^  or  threshold;  but  we  also  felt  that  it  could  .affect 
detection  efficiency ,  or  effective  signal  detectability.  The 
distinction  between  these  two  aspects  of  detection  behavior  is 
one  of  the  important  contributions  of  signal  detection  theory 
to  psychology. 

We  intended  to  measure  operator  detection  performance 
against  a  given  set  of  signals  in  a  setting  which  would  first 
minimize  apparent  command  attention;  and  measure  performance 
of  the  same  operators  against  the  same  stimuli  in  a  setting 
in  which  maximum  possible  command  attention  would  be  brought 
to  bear.  The  intent  was  not  to  explicitly  manipulate  the 
reporting  criterion,  but  to  create  two  situations  genuinely 
perceived  by  the  operators  to  be  of  very  different  importance 
with  respect  to  their  detection  performance.  Ke  wished  to  use 
the  .4N/SQS-26  sonar  as  the  vehicle  for  this  experiment  because 
of  its  status  as  the  Navy's  principal  long-range  active  sonar. 

Method 

To  accomplish  the  objectives  set  forth,  it  was  necessary 
to  place  a  number  of  fleet  scnar  operators  in  a  credible  set¬ 
ting  of  high  "command  attention"  while  providing  a  realistic 
sonar  display.  This  requircnent  ruled  out  an  at-sea  experi¬ 
ment,  since  realistic  detection  situations  for  several  opera¬ 
tors  could  not  be  set  up  without  prohibitive  requirements  for 
ship  services;  and,  in  any  event,  experimental  control  of  many 
important  variables  would  be  completely  lacking,  leading  to 
"unrepeatability"  which  would  prc'.  t  meaningful  comparative 
analyses  of  the  data.  Performing  the  experiment  employing  a 
shipboard  sonar  at  the  dock  was  not  feasible  either,  because 
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the  only  nethod  of  realistically  activating  the  sonar  would 
have  been  with  tape  recordings  of  signals  and  reverberations, 
which  were  not  then  available  for  the  AN/SQS-26  sonar.  The 
signal  injection  equipment  which  is  part  of  the  sonar  set 
could  not  be  used  because  that  equipnent  is  nounted  in  the 
sonar  control  rooD  (with  the  display  consoles)  ,  so  that  no 
covert  way  was  available  to  laanipulate  the  controls  necessary 
to  simulate  targets - 

The  nature  of  the  AK/SQS-26  A-scan  display,  however, 
permitted  a  very  satisfactory  experimental  approach.  This 
display,  unlike  older  soacr  displays,  is  a  memory-type  device 
which  presents  a  history  of  up  to  the  "last  six  pings"  in  a 
static:  presentation.  This  static  characteristic  permitted 
the  use  of  still  photography  to  create  a  realistic  representa¬ 
tion  of  the  sonar  display.  We  photographed  an  AN/SQS-26 
A-scan  display  after  each  ping  was  "painted"  onto  the  display, 
then  projected  the  resulting  ping-by-ping  sequences  of  color 
transparencies  by  rear  projection  techniques  onto  translucent 
display  screens  of  exactly  the  same  site  as  the  sonar  display 
CRT.  The  resulting  display  was  ver>'  similar  to  the  presenta¬ 
tion  observed  at  the  sonar;  in  fact,  none  of  the  operators 
tested  felt  it  was  different  in  any  significant  way  from  the 
presentations  on  their  own  equipment. 

Details  concerning  the  stimulus  materials,  the  apparatus, 
the  subjects,  the  procedure,  and  the  experimental  results  are 
given  in  the  following  sections. 

StirruZus  UateviaZs 

.An  AM/SQS-26  CX  located  at  the  Fleet  .ASK  School,  San 
Diego,  was  used  to  prepare  the  stimulus  materials.  The  tar¬ 
get  simulation  capability  incorporated  in  the  sonar  (Unit  34), 
which  provides  selection  of  simulated  target  course,  speed, 
rarge,  bearing,  echo  intensity,  and  own-ship  heading  and 
speed,  was  suitable  for  generating  targets  for  the  detection 


task.  Hoifever,  the  noise  generator  which  is  a  part  of  this 
unit  proved  unsatisfactory  as  a  source  for  noise/reverbera¬ 
tion  siEuiation,  since  the  sane  voltage  waveforB  is  introduced 
into  all  24  sonar  channels,  providing  total  spatial  coherency. 
This  produces  very  obvious  noise  "bands"  across  the  entire 
sonar  display,  and  is  easily  detected  as  being  artificial. 
Therefore,  we  constructed  a  special  .4H/SQS-26  noi se/reverbera- 
tion  generator.  The  device  was  designed  to  provide  broadband 
Gaussian  noise  across  the  sonar  bandwidth,  and,  for  reverbera¬ 
tion  siBulation,  white  Gaussian  noise  passed  through  a  rela¬ 
tively  broad  bandpass  filter  for  FM  (also  called  coded  pulse, 
or  C?)  channel  reverberation,  and  a  very  narrow  bandpass 
filter  for  Cb‘  channel  reverberation.  .4  solid  state  active 
filter  systen  was  designed  and  a  prototype  was  constructed 
and  tested  for  a  single  bcas  of  the  sonar.  The  prototype 
design  proved  to  be  very  satisfactory,  so  the  final  unit  was 
constructed.  This  unit  as  12  independent  solid  state  noise 
generators,  12  active  bandpass  filters  for  CP  reverberation 
siBulation,  12  active  bandpass  filters  for  CK  reverberation 
siaulaticn,  and  operational  asplifiers  for  the  linear  coh- 
binalion  of  the  various  noi se/reverberation  outputs.  Khile 
each  sonar  beaa  receives  its  prisary  energy  froa  the  asso¬ 
ciated  channel  within  the  noise  generator,  it  also  receives 
sone  energy  froB  adjacent  channels  of  the  generator,  siHulat- 
ing  the  lisited  spatial  coherency  evident  in  actual  sonar 
operation,  which  results  froH  overlapping  beaBs ;  the  necessary 
Bixing  is  done  within  the  noisc./rcverberation  generator.  The 
12  outputs  of  the  generator,  each  containing  the  CP  and  CS 
backgrounds  for  a  given  beaa,  are  fed  into  the  12  post- 
acplifiers  of  the  sonar  set  which  isscdiately  follow  vertical 
and  horizontal  bcas  foraing.  .4  schcsatic  diagras  of  the 
noise/reverberation  generator  is  given  in  .Appendix  C. 

Kith  the  noi se,- reverberat ion  gerscrator  conrsccted  to  the 
sonar,  the  .A-scan  display  was  adjusted  according  to  XUSC/New 


D  j 


y  .1 

r.  ij 

I  I  !  i 

L  1  I  -I 


!!  '  5 


London  Technical  Menoranduu  2134-540-70.  All  transparencies 
of  the  -A-scan  display  were  photographed  with  a  20-Kyd  tone 
width  and  with  the  sonar  in  the  single  storage  laode,  which 
permitted  a  ping-by-ping  history  to  build  up  from  zero  to 
six  pings.  It  also  permitted  use  of  one  storage  tube  only, 
and  optiaitation  of  display  adjustnents.  The  photographs 
were  taken  with  a  Nikon-F  caaera  and  Micro-NIKKOR  .Auto  F3.5, 

SSsa  lens  with  settings  of  f5.6  and  1/8  second  on  Kodak  High 
Speed  Ektachroae  file  froa  a  distance  of  apprcxinately  30 
inches,  and  were  noraally  processed.  .A  four-digit  light- 
eaittir.g-diode  numerical  display  was  mounted  on  the  lower 
right-hand  portion  of  the  sonar  CRT,  which  permitted  record¬ 
ing  the  sequence  nuaber  (1  to  72)  and  the  ping  number  (1  to 
6)  in  the  image  on  each  slide.  Sequences  of  6  consecutive 
pings  were  photographed  in  the  following  way:  The  display 
was  erased,  and  the  sequcnce/ping  nuaber  counter  was  ini¬ 
tialized.  The  test  target,  if  one  was  to  be  present,  was 
inserted  with  the  proper  parameters  for  the  first  ping,  and 
the  sonar  was  allowed  to  cycle  normally.  .Aftar  the  first 
ping  was  fully  recorded  on  the  displaj.',  the  first  photograph 
was  taken.  During  the  sonar  dweil-time,  the  target  echo 
intensity  was  adjusted  to  the  proper  value  for  the  second 
ping,  according  to  a  schedule  of  random  signal  intensities. 

.After  the  second  ping  had  fully  developed,  the  second  photo¬ 
graph  was  taken;  and  so  on.  Thus,  each  photograph  represented 
the  sonar  display  as  it  actually  appeared  after  a  given  nanber 
of  pings.  This  process  was  continued  until  the  sixth  ping 
was  completed  and  photographed.  .A  sequence  of  six  slides  thus 
depicted  the  sequential  development  of  six  simulated  sonar 
pings. 

A  total  of  72  six-ping  sequences  was  photographed,  24 
sequences  with  noise/ reverberation  background  only;  24  with 
the  noise/reverberation  background  plus  an  FH  (or  C?)  target; 
aud  24  with  the  noise/reverberation  background  plus  a  CW  target. 
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For  th^;  sequences  containing  targets,  target  ranges  and  bear¬ 
ings  Here  random  zed  to  approximate  a  uni  fora  distribution 
over  the  sonar  display;  and  target  range-rate  was  randomized 
to  approxiaats  a  uniform  distribution  within  the  following 
intervals:  25  to  15  knots  closing;  5  knots  closing  to  5  knots 

opening;  and  15  to  25  knots  opening.  h'ithin  each  signal  se¬ 
quence,  the  signal  level  was  randomized  from  ping  to  ping 
with  an  approximate  normal  distribution  with  3.5  db  standard 
deviation,  which  is  representative  of  actual  AH/SQS-26  opera¬ 
tion;  and  with  a  mean  signal -to-noise  ratio  approximately 
equal  to  the  sinisua  detectable  level  (MDL)  for  the  particular 
signal  type  (CP  or  CK) .  Thus,  aany  pings  within  a  signal 
sequence  typically  did  not  contain  psreeptihtc  echoes,  even 
though  a  signal  had  been  injected.  These  parameters  realis¬ 
tically  siaulated  ’’dif ficult-to-detect"  targets. 

After  developing,  the  resulting  slides  were  inserted 
into  Kodak  Carousel  slide  trays,  9  sequences  (54  slides)  to 
a  tray,  for  a  total  of  8  slide  trays. 

Appi22=aius 

Five  rear-projection  display  screens  were  constructed 
with  10-5/4"  wide  by  11"  high  viewing  areas  (approxinately 
the  sane  size  as  the  CRT  sonar  display)  mounted  in  16"  wide 
by  IS*'  high  frames  with  ranga  scales  on  the  right  and  left 
sides  and  "bcaa  number"  scales  at  the  top  and  bottom  to  per¬ 
mit  operators  to  estiaate  the  range  and  bearing  of  a  target. 


Five  Kodak  S5C  Autofocus  slide  projectors  with  zoom 
lenses  were  enployce  to  project  the  sonar  display  images. 


The 


aat 

the 

The 


il 


automatic  focus  feature  kep 
ically,  and  the  zoom  feature 
images  to  the  same  scale  as 
rive  projectors  were  connec 
-8  timers,  which  'were  connec 


t  the  slides  in  focus  auto- 
permitted  adjustment  of 
the  original  sonar  display, 
ted  to  a  pair  of  Hunter  Model 
ted  in  flip-flop  cent i gurat i on 


to  provide  .300 


ruist-s  (actually,  contact 


millisecond  advance 


closures)  simultaneously  to  the  five  projectors  every  25 
seconds . 

Response  buttons  v.’ere  provided  each  operator  for  reporting 
sonar  contacts .  Each  response  button  was  connected  by  wire  via 
an  "interface  box"  to  a  single  tape  recorder,  which  was  run 
•ring  each  experimental  session.  The  operators  were  told  that 
e  ping  number  corresponding  to  their  push  button  response  was 
oeing  recorded  electronically,  to  discourage  claiming  "early" 
detections  by  writing  in  ping  numbers  on  their  pen-and-paper 
response  sheets  that  occurred  earlier  than  the  point  in  time  at 
which  the  reporting  decision  was  actually  made.  In  fact,  data 
on  response  time  were  not  actually  recorded  electronically. 

Subjects 

Twenty  U.  S.  Navy  sonar  technicians  from  AN/SQ3-26  ships 
at  Newport,  Rhode  Island,  served  as  subjects.  Two  of  these 
were  transferred  before  completing  the  experiment,  and  two 
more  were  found  to  have  no  operational  experience  with  the 
AN/SQS-26  A-scan  display.  The  remaining  16  were  qualified 
watchstandors  or  watch  supervisors.  Six  had  1  year  or  less 
of  shipboard  experience,  while  10  had  more  than  a  year  of 
experience.  The  16  men  included  the  following  rates.  four 
STG-2;  ten  STG-3;  two  STG/SN.  As  a  group,  their  qualifications 
appeared  typical  of  present-day  shipboard  sonar  personnel. 

Procedure 

The  octection  experiment  was  arranged  to  be  conducted  in 
N'.wport,  Rhode  Island,  through  the  cooperation  of  Commander, 
D'.stroyer  Development  Group.  Excellent  experimental  facili¬ 
ties  were  provided  us  in  a  room  at  the  Naval  Underwater 
Systems  Center,  Newport.  The  windows  were  blacked  out  to 
permit  loiv-lcvel  artificial  illumination  during  the  experi¬ 
ment,  and  five  xperiment  booths  were  placed  in  the  room  in 
such  a  manner  that  each  subject  sat  in  a  cubicle  which  pre¬ 
vented  his  seeing  other  sonarmen  or  their  displays.  Each 
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sonarman  sat  in  a  student's  chair,  v;hich  provided  him  with  a 
writing  surface,  and  the  rear-projection  screens  were  placed 
on  small  tables  immeo'iately  in  front  of  him.  The  slide  pro¬ 
jectors  were  set  up  side-by-side  across  the  room  from  the 
five  adjacent  subject  booths,  and  the  projector  remote-control 
cables  were  all  connected  to  the  timing  apparatus  situated  at 
the  experimenter's  station. 

Five  sonarmen  performed  the  detection  task  at  a  time. 

All  the  operators  were  given  their  "irst  session  during  a 
single  week,  and  their  second  session  during  the  following 
week.  Arrangements  for  sonarmen  to  serve  as  subjects,  and 
for  their  transportation  to  and  from  the  experimental  site, 
were  provided  in  a  very  effective  manner  by  Destroyer  De¬ 
velopment  Group. 

Prior  to  commencing  the  detection  task  during  the  first 
w.ek,  the  instructions  reproduced  in  Appendix  D  were  read  to 
the  sona*men,  and  sample  photographic  transparen''.ie3  were 
shown  to  demonstrate  the  display  and  the  sonar  contact  report¬ 
ing  procedure.  This  procedure  (which  may  be  best  understood 
by  reading  Appendix  D)  called  for  a  sonar  contact  report  only 
when  the  sonarman  felt  he  recognized  a  contact.  This  method 
was  felt  to  most  realistically  approximate  the  actual  sonar 
detection/reporting  task  (in  contiast  to  the  frequently  im¬ 
posed  forced-choice  situation  associated  with  detection  theory 
experiments,  which  requires  responses  at  fixed  intervals). 

The  sonarmen  were  instructed  that  when  they  wished  to  report 
a  contact,  they  should  immediately  press  the  response  push 
botton,  then  record  certain  pertinent  iata  concerning  the 
contact  on  one  of  the  response  sheets  freproduced  in  Appendix 
E) .  They  were  to  record  the  sequence  number  and  ping  number 
on  which  they  responded,  whether  the  target  was  on  the  CP  or 
CV>  portions  of  the  disj)lay  (or  both),  the  estimated  range  of 
the  c-''ntact,  the  beam  number,  and  whether  the  target  appeared 
to  have  an  opening,  closing,  or  zero  range  rate.  More  than 
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one  report  per  sequence  could  be  made;  or  none  could  be  made. 
The  operator  was  also  required  to  evaluate  the  quality  of 
each  contact  he  reported  at  the  end  of  the  sequence  contain¬ 
ing  that  contact.  This  was  done  by  indicating  whether  the 
contact  was  judged  to  be  ’'good,*'  "fair,"  or  "marginal."  he 
was  also  permitted  to  revise  his  contact  judgments  after  ail 
six  pings  had  been  presented;  this  on  occasion  led  to  the 
conclusion  that  an  early  report  was  in  fact  "not  a  contact." 

The  slides  were  advanced  at  25-second  intervals  (slightly 
faster  than  real  time)  and  were  presented  continuously  within 
blocks  of  18  six-ping  sequences,  taking  45  minutes;  there  leere 
five-minute  breaks  between  blocks,  during  ’which  the  subjects 
could  move  about.  The  total  duration  of  the  detection  task 
was  about  3  hours  plus  time  for  instruction  of  the  subjects 
and  for  breaks.  All  subjects  completed  the  task  during  the 
morning  hours  (0800  to  1130)  of  normal  working  days. 

As  can  be  seen  from  .Appendix  D,  dur’  g  the  first  session 
(Condition  I),  the  operators  were  told  that  the  purpose  of 
the  task  they  were  to  perform  v;as  to  learn  "what  constitutes 
a  reportable  contact  v/ith  the  AN/SQS-26  sonar."  No  uniformed 
Navy  officers  or  enlisted  personnel  were  in  the  vicinity, 
and  only  the  civilian  experimenter  and  the  subjects  were  pres¬ 
ent  within  the  experiment  room.  Thus,  while  the  environment 
for  each  sonarman’s  first  session  was  certainly  novel  for  him 
in  some  respects,  we  think  these  novelties  can  be  character¬ 
ized  as  those  of  an  "experiment,'  conducted  by  civilian 
researchers,  having  no  clear  connection  with  his  accustomed 
environment  (the  operational  Navy) ;  and  without  clear  conse¬ 
quences  for  cither  errors  or  error-free  performance  of  the 
task.  The  origin  of  the  stimulus  materials  was  never  dis¬ 
cussed  with  the  sonarmen,  and  knowledge  of  results  was  never 
given. 

In  contrast,  when  the  sonarmen  arrived  for  their  second 
session  during  the  subsequent  week  (Condition  II),  a  U.  S. 


Navy  Commander,  in  uniform,  was  present  in  the  room.  When 
the  sonarmen  were  all  present  and  their  identities  verified, 
they  were  addressed  by  this  officer.  He  made  a  statement  to 
the  men  (from  memory)  following  this  guideline: 

The  exercise  last  week  was,  in  reality,  just 
a  warm-up  for  the  very  important  cask  I  want 
you  to  perform  today.  In  the  interest  of  de¬ 
veloping  optimum  tactics  against  the  Soviet 
submarine  threat,  you  are  being  asked  to  view 
a  series  of  recently  acquired  data  where  it 
is  known  that  a  number  of  targets  may  be 
detectable.  Security  prevents  my  discussing 
the  nature  of  these  data  in  detail,  but  it 
is  extremely  important  that  every  valid  con¬ 
tact  be  identified  as  such.  Our  estimate  of 
the  threat  clearly  depends  on  the  most  ac¬ 
curate  information  we  can  get  in  this  respect. 
Therefore,  please  report  any  contact  that  you 
feel  qualifies  as  a  "possible  sub."  Report 
at  the  earliest  point  in  the  sequence  where 
you  feel  such  a  report  should  be  made. 

Following  this  statement,  the  men  were  seated  in  their  booths 
and  given  "Condition  II"  response  booklets.  (The  Commander 
was  not  present  during  the  actual  detection  task.)  These 
were  of  the  same  format  as  the  "Condition  I"  booklets  with 
three  very  apparent  exceptions:  the  pages  were  pink  rather 
than  white;  the  pages  were  conspicuously  marked  "SECRET  NOFORN 
when  any  identifier  block  completed";  and  each  page  had  this 
"identification  block"  (which  was  never  in  any  case  completed) : 


IDENTIFIER 

Contact  Code 

(1) 

p{D) 

{4) 

BLOCK 

Dd  not  vi/rite 

Tn  this  space 

Threat  Code 

(2) 

P(FA) 

(5) 

Type 

(3) 

Z-Code 

(6) 

_ 1 

A  sample  page  from  "Condition  II"  response  booklet  is  shown 
i.'  Appendix  F. 


Therefore,  the  setting  for  the  detection  task  in  t'ue 
second  session  was  quite  different  from  the  first.  Every 
effort  was  made  to  make  performance  of  the  detection  task 
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appear  relevant  and  consequential  to  the  "operational  Navy" 
via  the  "coianand  attention"  focused  upon  it.  (Hopefully,  this 
was  not  a  deception--we  certainly  intended  this  research  to 
be  "relevant  and  consequential!")  The  intent  was  to  create  a 
detection  situation  which,  while  net  in  an  at-sea  tactical 
environment,  was  genu-inely  perceived  by  the  operators  to  be 
analogous,  and  not  "merely"  a  research  exercise.  Ke  believe 
that  the  photographic  reproductions  of  the  display,  which 
could  have  been  recorded  during  a  tactically  significant  en¬ 
counter  (an  explanation  for  their  origin  which  was  at  least 
implicit  in  the  second  session),  and  the  delivery  of  the  Con¬ 
dition  II  instructions  by  a  Navy  Commander,  did  indeed  set 
the  scene  as  we  desired. 

Independent  Vaviahles 

We  review  and  summarize  the  independent  experimental 
variables  here,  and  the  criterion  variables  in  the  next  sec¬ 
tion,  as  a  prelude  to  description  of  the  experiment  results. 

Command  Attention.  Two  levels,  "low"  and  "high,"  were 
administered  during  each  subject’s  first  and  second  experi¬ 
mental  sessions,  respectively,  as  previously  described.  It 
should  be  noted  that  this  experimental  design  is  not  "balanced 
with  respect  to  the  "command  attention"  variable,  in  that  the 
two  levels  of  this  variable  were  always  administered  in  the 
same  sequence.  In  general,  this  design  invites  the  confound¬ 
ing  of  such  sequence  effects  as  "learning"  with  the  principal 
experimental  variable.  The  nature  of  the  "command  attention" 
variable,  however,  does  not  at  all  lend  itself  to  administra¬ 
tion  in  the  opposite  sequence;  that  is,  administration  of  the 
"high  command  attention"  level  during  the  first  session  would 
make  it  doubtful  that  a  satisfactory  control  condition  could 
be  achieved  during  the  second  session.  For  this  particular 
experiment,  however,  we  felt  that  "learning"  effects  would 
have  a  negligible  influence,  for  at  least  two  reasons:  (1) 
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each  subject  was  an  experienced  AN/SQS-26  operator  who  was 
quite  fa'iiiliar  with  the  infcrnation  display  employed  in  the 
experiment;  and  (2)  no  feedback  of  performance  results  was 
ever  provided. 

Signal  Type.  Equal  numbers  of  FM  (also  called  C?)  and 
CW  simulated  targets  were  represented  in  the  stimuli,  which 
appear  on  separate  parts  of  the  CRT  sonar  display.  Since 
the  character  of  these  two  types  of  signals,  as  displayed, 
is  very  different  (principally  owing  to  processing  bandwidth 
differences) ,  it  is  reasonable  to  expect  differences  in  per¬ 
formance  at  detecting  these  signals.  Therefore,  the  sonar 
contact  reporting  procedure  was  designed  to  permit  differen¬ 
tiation  of  "FM"  and  "CW"  targets. 

Tiire  Blocks.  Each  3-hour  experimental  session  was 
divided  into  four  45-minute  "tine  blocks"  by  S-ninute  breaks, 
as  previously  described.  The  experimental  data  were  analyzed 
with  respect  to  time  blocks  to  reveal  possible  tine  effects 
on  performance. 

Criterion  Variables 

Coi'reot  and  False  Report^:  Each  sonar  contact  report 

was  scored  "correct"  if  met  t.  •  .ollowing  criteria: 

1.  The  ping  sequence  dui^  ich  the  report  was 

made  must  have  been  one  i.  those  48  in  which 
a  simulated  target  was  injected. 

1.  The  report  must  have  indicated  the  correct 
signal  type  (FM  or  CW) . 

3.  The  estimated  range  of  the  target  must  have 
been  within  5  Kyds  of  the  "true"  range  of 
the  target  (i.e.,  the  range  at  which  it  was 
injected)  within  the  displayed  zone. 

4.  The  sonar  beam  which  the  target  was  estimated 
to  be  in  must  have  been  within  3  beams  of  its 
"true"  beam  (i.e.,  where  it  was  originally 

in j  ected) . 
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If  a  sonar  contact  report  failed  to  meet  any  of  these  criteria, 
it  was  scored  as  a  "false”  report. 

It  was  expected  that  range  and  bearing  estimation  preci¬ 
sion  would  be  considerably  better  than  the  allowed  tolerances 
(which  it  proved  to  be) ,  even  without  the  aid  of  the  sonar 
range/bearing  cursor,  which  was  not  availa’^le  to  the  operators. 
These  I'olerances  were  selected  to  provide  a  generous  interval 
for  the  range/beam  accuracy  analysis  discussed  below;  the  four 
criteria,  together,  \t’ere  sufficiently  strict  to  provide  the 
necessary  discrimination  of  "correct"  from  "false"  reports - 

Reported  Quality  Level.  It  was  expected  to  be  of  interest 
to  compare  the  quality  judgments  for  "correct"  target  detection 
reports  with  those  for  "false"  reports,  as  an  indicator  of  the 
diagnostic  value  of  the  judgments  in  distinguishing  valid 
targets . 

Range  and  Beam  Estimation  Accuracy.  For  each  correct 
report,  the  differences  between  the  estimated  range  and  beam 
and  the  "true"  range  and  beam  of  the  injecced  target  were 
calculated  to  be  used  as  additional  performance  measures. 

Ring  Number.  Because  latency  of  sonar  contact  reporting 
is  an  operationally  important  variable  (see  "Results:  Conse¬ 
quences  of  Delayed  Contact  Reporting"  in  the  previous  chapter) , 
all  sonar  contact  reports  made  during  the  experiment  were 
identified  by  the  ping  number  on  which  they  occurred.  (All 
six-ping  sequences  which  contained  targets  had  target-plus- 
background  present  for  all  six  pings,  but  because  a  particular 
sequence  represented  a  realization  of  a  normal  random  process-- 
with  mean  signal-to-noise  ratio  at  the  minimum  detectable 
level,  and  a  standard  deviation  nf  3.5  db--the  signal  may  in 
fact  have  been  undetectable  for  several  pings-  therefore, 
reporting  latency  must  be  considered  across  all  sequences  to 
achieve  a  statistically  meaningful  latency  measure  which 
combines  operator,  signal,  and  noise  random  processes.) 
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Results 

In  this  section,  the  effects  of  the  independent  experi¬ 
mental  variables  are  analyzed  and  described  in  relation  to 
each  of  the  criterion  variables  in  turn. 

Bf feats  on  Number  of  Correct  and  False  Reports.  A  three- 
factor  analysis  of  variance  was  calculated  for  the  .lunber  of 
correct  reports  and  the  number  of  false  reports,  based  upon 
the  2  (levels  of  command  attention)  x  2  (FM  or  CK  signal  type) 
X  4  (time  blocks)  within-sub j ects  experimental  design.  A  sum¬ 
mary  of  the  analysis  of  variance  for  correct  reports  is  shown 
in  Table  3,  and  for  false  reports  in  Table  4.  It  can  be  seen 
that  for  correct  reports,  "signal  type"  had  a  significant 
main  effect  (p  <  .05)  and  the  "command  attention"  x  "signal 
type"  interaction  had  a  significant  effect  (p  <  .05),  For 
false  reports,  it  can  be  seen  that  "command  attention"  had  a 
significant  main  effect  (p  <  .01)  and  "signal  type"  had  a  sig¬ 
nificant  main  effect  (p  <  .01).  "Time  Blocks"  had  no  statis¬ 
tically  significant  effects  in  this  experiment. 

Figures  14  and  15  show  the  total  numbers  of  correct  and 
false  reports  obtained  in  the  experiment,  respectively, 
classified  by  the  two  independent  variables  revealed  by  the 
analyses  of  variance  to  be  significant:  "command  attention" 
and  "signal  type."  Figure  14  shows  that  there  were  more  CK 
correct  reports  than  FM  correct  reports  (recall  that  equal 
numbers  of  detection  opportunities  ivere  presented  for  each 
signal  type),  and  that  the  "high"  level  of  command  attentioi 
resulted  in  a  very  slight  decrease  in  the  number  of  correct 
FM  reports ,  but  a  substantial  increase  in  the  number  of  cor¬ 
rect  CW  reports,  compared  to  the  "low"  level  of  command  at¬ 
tention.  This  differential  effect  of  "command  attention"  on 
FM  and  CW  correct  reports,  of  course,  resulted  in  the  signif¬ 
icant  "CA  X  ST"  interaction  shewn  in  Table  5,  but  caused  the 
"CA"  main  effect  to  fall  short  of  the  statistical  significance 
criteri on . 
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Figure  15  shows  that  there  were  nany  sore  CW  false  reports 
than  FM  false  reports,  and  that  the  ’’high”  level  of  cossand 
attention  suhstantiatty  veduaed  the  nuabers  of  both  C’r;  and  FM 
false  reports,  coapared  to  the  ’’low"  level  of  coaraand  atten¬ 
tion.  Since  the  "high”  level  of  coaaand  attention  reduced  both 
CW  and  FM  false  reports,  the  "CA  x  ST*  interaction  was  not 
significant  ^ot  false  repoi-ts  (Table  4) - 

Thus,  -he  "high"  level  of  coaaand  attention  resulted  in 
a  signifiaant  improvement  in  detection  performance ,  coapared 
to  the  "low"  level,  by  reducing  FM  false  reports  by  50%  while 
reducing  FM  correct  reports  by  only  4%;  and  by  reducing  CK 
false  reports  by  31%  while  increasing  CK  correct  reports  by 
20%.  The  differential  effect  by  signal  type  is  attributed  to 
the  different  psychophysical  tasks  presented  by  the  FM  and  CK 
portions  of  the  display. 

Effects  on  the  Diagnostic  Value  of  "Contact  Quality" 
Judgments.  Figure  16  shows  the  distribution  of  correct  and 
false  reports  aacng  the  "contact  quality"  categories.  (Recall 
that  a  ’quality"  judgnent  was  required  for  each  contact  report 
the  operators  aade.)  It  can  be  seen  froa  the  distribution  of 
all  correct  reports  aaong  the  "quality"  categories  that  the 
nost  likely  quality  judgaent  for  reports  elicittl  by  genuine 
target:^  was  the  highest  level,  "good,"  containing  approxiaately 
half  of  all  correct  reports  sade.  The  proportions  of  correct 
reports  given  lesser  quality  judgaents  decreased  aonotonically 
with  the  decreasing  "quality"  descriptors - 

On  the  other  hand,  it  can  be  seen  f 'Oe  the  distribution 
of  all  false  reports  aaong  the  "quality"  categories  that  the 
aost  likely  quality  judgaent  for  reports  elicited  by  the 
noise/reverberation  background  was  the  second  highest  level, 
"fair,"  containing  approxiaately  40%  of  all  false  reports  aade. 

Thus,  the  distributions  shown  in  Figure  16  indicate  that 
the  subjects'  "contact  quality"  judgments  had  diagnostic  value 


in  discxiainating  correct  fros  false  reports.  This  diagnostic 
potential  say  be  exaEined  Eore  directly  by  considering  the 
proportion  of  ail  (i.e.,  correct  plus  false)  reports  in  a 
given  quality  category  which  proved  to  be  correct.  For  ex- 
asple,  for  the  "Iok"  level  of  coasand  attention,  there  were 
62  FM  targets  reported  at  the  highest  quality  level  ("good") , 
46  of  which  were  scored  correct.  Therefore,  the  proportion 
of  correct  reports  for  the  specified  conditions  was  46/62  = 
0.74.  Figure  17  shows  the  proportions  of  reports  in  each 
quality  category  which  proved  to  be  correct,  by  signal  type, 
reported  contact  quality,  and  level  of  coamand  attention. 

It  can  be  seen  fron  Figure  17  that,  without  exception, 
the  proportion  of  correct  reports  increased  conotonically 
with  increasing  perceived  quality  levels.  For  exaaple,  for 
FM  reports  nade  during  the  "low"  cons  1  attention  condition, 
48%  of  the  contacts  judged  to  be  of  "sarginal"  quality  proved 
to  be  correct,  58%  of  the  "fair"  reports  proved  to  be  cor¬ 
rect,  and  74%  of  the  "good"  reports  proved  to  be  correct - 

Th^  proportion  of  correct  FM  reports  in  each  quality 
category  is  seen  to  be  greater  in  every  case  than  the  cor¬ 
responding  proportion  of  correct  CK  reports-  This  is  the 
result  of  core  "strict"  reporting  criteria  enployed  by  the 
operators  for  the  FM  display,  an  explanation  substantiated 
by  the  fact  that,  while  equal  nusbers  of  FM  and  CW  targets 
were  presented,  fewer  correct  (and  false)  FM  reports  than 
CYi  reports  were  Bade  during  the  experiEent. 

It  can  also  be  seen  fron  Figure  17  that  the  "high"  level 
of  coBsand  attention  resulted  in  isproved  target  discriHina- 
tion  perfornance  in  every  contact  quality  category,  for  both 
types  of  signals.  For  exasple,  for  FM  targets  in  the  "good" 
category,  the  proportion  of  correct  reports  was  increased 
froB  74%  for  the  "low"  level  of  coasand  attention  to  84%  for 
the  "high"  level-  Similar  iaprovesents  are  seen  in  the  other 
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categories.  This  improvement  in  target  discrimination  perfor¬ 
mance  resulted  from  the  employment  of  more  "strict"  reporting 
criteria  during  the  "high"  command  attention  condition.  Gen¬ 
erally,  (when  "detection  efficiency,"  or  effective  signal 
detectability,  is  constant),  the  penalty  paid  for  an  improve¬ 
ment  in  discrimination  performance  (which  must  be  obtained 
through  a  f<hift  to  a  more  “strict"  or  “cautious"  reporting 
criterion)  is  a  decreased  probability  of  detection ,  resulting 
from  thr  consequent  decrease  in  numbers  of  false  and  correct 
reports.  In  this  case,  however,  the  increase  in  target  dis¬ 
crimination  performance  brought  about  by  the  "high"  level  of 
command  attention  was  accompanied  by  only  a  4%  decrease  in 
the  number  of  correct  FM  reports,  and  by  a  20%  increase  in 
correct  CW  reports,  compared  to  the  "low"  command  attention 
condition.  Thus,  it  must  be  concluded  that  detection  effi¬ 
ciency,  or  effective  signal  detectability  for  the  display- 
operator  system,  was  greater  for  the  "high"  level  of  command 
attention  than  for  the  "low"  level.  This,  of  course,  is  a 
very  desirable  result;  it  is  considered  in  greater  detail  in 
the  section  on  "Signal  Detection  Theory  Analysis." 

Effects  on  Range  and  Beam  Estimation.  Another  indication 

of  improved  performance  during  the  "high"  command  attention 

condition  may  be  seen  in  Figure  18.  This  figure  shows  the 

means  of  the  absolute  values  of  errors  in  estimating  the  range 

to  valid  targets  (i.e.,  n~^E|R^  -R  ^  ,1)  for  the  two 

®  ^  ’  '  true  estimated*'^ 

levels  of  command  attention.  A  significant  decrease  Cz=3.3, 
p  <  .001)  in  mean  range  estimation  error  was  obtained  for  the 
"high"  level  of  command  attention,  compared  to  the  "low"  level, 
representing  a  19%  improvement  in  target  range  estimation  per¬ 
formance.  (Note  that  while  these  range  estimation  errors  are 
useful  measures  of  performance  between  the  two  command  atten¬ 
tion  conditions  of  this  experiment,  their  actual  values  are 
not  to  be  taken  as  estimates  of  AN/SQS-26  range  accuracy, 
since  the  sonarmen  did  not  have  the  electronic  range  cutsot 
normally  used  for  this  purpose.) 
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hliile  range  estiaation  was  perforaed  on  a  continuous 
scale  from  zero  to  20,000  yards,  target  hear:  estiaation  was 
a  rather  ^coarse,"  discrete  task  offering  only  12  response 
possibilities.  Mean  absolute  bean  estiaation  accuracy  during 
the  "lok-"  coaaand  attention  condition  was  0.71  bean,  which 
left  little  room  for  inprovenent .  Mean  absolute  bean  accuracy 
during  the  "high"  coaaand  attention  condition  was  0.70  beaa, 
not  significantly  different. 

DistTihuti-on  of  Reports  by  Ping  Sunher.  Figure  19  shows 
the  distribution  of  all  sonar  contact  reports  by  the  ping 
nuaber  (1-6)  on  which  they  were  lade.  There  were  no  aeaning- 
ful  differences  in  this  distribution  by  level  of  coaaand 
attention,  signal  type,  or  correct  versus  false  reports.  How¬ 
ever,  it  should  be  noted  that  since  each  target  sequence  pre¬ 
sented  six  "echoes"  with  uncorreiated,  normally  distributed 
signal  intensity  probabilities,  a  single  target  sequence  can 
be  regarded  as  a  single  realization  of  a  six-variate  un¬ 
correiated  normal  probability  distribution  (with  equal  means 
n=MDL  and  equal  standard  deviations  o=3.S  db) .  Therefore, 
the  48  target  sequences  do  not  represent  a  very  large  sample 
(of  a  six-variate  joint  probability  distribution)  and  do  not 
permit  great  precision  in  looking  for  differences  in  reporting 
distributions  by  ping  number.  Thus,  one  cannot  confidently 
conclude  from  these  data  that  there  are  none. 

It  can  be  seen  from  Figure  19  that,  with  one  exception, 
the  proportion  of  contact  reports  increased  monotoni cally  with 
the  ping  number.  Very  few  reports  were  made  on  the  first  and 
second  pings;  the  majority  of  reports  (84%)  occurred  on  pings 
4,  S,  and  6.  This  result  was  expected,  since  multiple  observa¬ 
tions  are  an  extremely  important  factor  in  sonar  detection. 

This  fact  is  the  principal  reason  for  providing  a  memory-type 
display,  and  its  utilization  is  reflected  in  a  survey  of 
SQS-26  operators,  in  which  "echo  consistency"  (over  multiple 
observations)  was  the  clue  most  frequently  indicated  to  be  of 
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isportance  in  target  detection  (Stern,  1971).  Ke  feel  that 
the  sonar  detection  task  is  best  aodeled  as  a  sequeritidt 
analysis  task  (see  h'ald,  1947;  Sirdsall  and  Roberts,  1971), 
in  which  additional  observations  say  be  Bade  if  the  evidence 
at  hand  does  not  justify  a  detection  report.  This  Bodel 
prescribes  coaparatively  strict  reporting  criteria  for  deci¬ 
sions  based  on  few  observations,  beconing  less  strict  as  the 
nuaber  of  observations  increases,  as  a  result  of  the  greater 
statistical  significance  attached  to  likelihood  estiaates 
based  upon  greater  nuabers  of  observations-  Experiaental 
confiraation  of  the  use  of  reporting  criteria  by  sonar  opera¬ 
tors  which  vary  with  the  nueber  of  observations  has  been 
obtained  for  passive  sonar  (Harabedian  et  al.y  1970)  and 
for  active  sonar  (Rizy,  1972).  The  data  shown  in  Figure  19 
substantiate  these  findings. 

The  exception  to  aonctonically  increasing  proportions 
in  Figure  19  occurs  on  ping  5,  wnich  we  suggest  is  owing  to 
its  position  as  "next-to-last and  is  thus  an  experiacntal 
artifact.  On  ping  5,  the  sonaroen  had  a  slight  bias  toward 
taking  that  "last”  look.  If  ping  6  were  not  "last,"  the 
proportion  of  reports  Bade  on  ping  5  probably  would  not  have 
been  anoaalous. 

Signal  Detection  Theory  Analysis 

The  results  presented  in  the  last  section  were  based 
directly  upon  effects  seen  in  the  experinent  criterion  vari¬ 
ables,  without  transforaations  of  any  kind.  However,  it  is 
also  desirable  to  describe  the  results  in  terms  of  probability 
of  detection,  p(D),  probability  of  false  report,  p(FR),  the 
receiver  operating  characteristic  (ROC) ,  and  the  signal  de¬ 
tection  theory  statistics  d'  and  B.  These  descriptions  do 
require  transformations  of  the  direct  experimental  data,  which 
involve  certain  underlying  assumptions.  We  will  attempt  to 
clearly  identify  each  of  these  assumptions  as  they  are  made. 
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so  the  reader  sav  use  the  transforaed  data  in  a  coapletely 
inforaed  way. 

Frobah-Llity  of  Deteati.cn,  p{D} .  An  estiaator  of  p(D)  for 
the  stiauli  eaployed  in  this  experiaent  aay  be  foraed  froa  the 
ratio  of  the  nuaber  of  correct  reports  (for  a  given  set  of  in¬ 
dependent  variables)  to  the  nuaber  of  detection  opportunities 
(for  that  set  of  variables) -  There  were  24  sequences  in  which 
an  FH  target  was  injected,  and  there  were  18  operators,  so 
there  were  a  total  of  432  detection  '♦pportunities  for  FM  tar¬ 
gets  for  each  level  of  coaeand  attention.  Likewise,  there 
were  24  CW  target  sequences,  sc  there  were  432  CK  target  de¬ 
tection  opportunities.  Thus,  we  may  fora  estiaates  for  p(D) 
for  the  experiaent  froa  the  observed  total  numbers  of  correct 
reports : 


COMMAND 

ATTE.HTI0N 

SIGNAL 

TYPE 

NUMBER 

CORRECT 

REPORTS 

OPPOR¬ 

TUNITIES 

P(D) 

Low 

FM 

126 

432 

.29 

High 

FM 

121 

432 

.28 

Low 

CW 

164 

432 

.38 

High 

CW 

198 

432 

.46 

It  can  be  seen  that  p(D),  for  each  condition,  fell  approxi- 
aately  in  the  range  0.3-0. 5,  indicating  that,  on  the  average, 
the  signals  were  in  the  "difficult-to-detecc"  region  which 
was  desired  for  this  experiaent.  Since  the  stiauli  were 
designed  to  produce  this  level  of  performance,  it  should  be 
obvious  that  these  p(D)  estiaates  cannot  be  regarded  as 
evaluative  of  the  operational  performance  of  the  AN/SQS-26 
sonar,  beyond  the  circular  conclusion  that  about  half  of  any 
signals  at  the  ’’aininua  detectable  .^evel"  will  be  detected. 

These  pCD)  estiaates  and  the  effects  of  the  independent 
variables  on  then  are  presented  graphically  in  the  section  on 
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the  "receiver  operating  characteristic"  vhich  follows  the 
discussion  of  p(FR). 

FTohahiZity  of  False  HepoTt^  p(FR).  An  estisator  of 
p(FR)  aay  he  foraed  froa  the  ratio  of  the  nuaber  of  false 
reports  to  the  numbei'  of  ways  in  which  the  non-signal  stim¬ 
uli  could  have  elicited  contact  TspoTts.  The  latter  tera  is 
easily  defined  for  experiaents  in  which  detection  opportuni¬ 
ties  occur  as  discrete  events  on  a  siaple  display.  In  the 
coaplex  task  of  sonar  detection,  however,  the  nuaber  of  false 
response  opportunities  presented  depends  on  nany  factors - 
The  principal  factors  are  discussed  in  turn  as  they  pertain 
to  the  sonar  detection  situation. 

1.  Characteristics  of  non-signal  sources  in  the 
water  wh'ch  can  give  rise  to  contact  reports: 
this  factor  is  of  obvious  importance  in  con¬ 
sidering  false  reports-  For  simulated  noise/ 
reverberation  backgrounds,  this  factor  is 
defined  by  the  characteristics  of  the  noise 
generating  apparatus. 

2.  Volume  of  water  searched,  and  the  spatial  res¬ 
olution  with  which  it  is  searched  (as  realized 
at  the  sonar  display) :  this  factor  deternines 
the  number  of  opportunities  the  non-signal 
sources  will  have  to  nark  the  sonar  display  on 
a  single  ping  (assuaing  an  isotropic  distribu¬ 
tion  of  these  sources;  otherwise,  their  dis¬ 
tribution  must  be  ta^-en  into  account) .  This 
factor  may  be  specified  in  terns  of  the  tine- 
bandwiuth  product  of  the  non-signal  information 
presented  on  the  entire  display  during  one  ping. 

3.  Characteristics  of  the  operator  as  a  detector: 
the  first  two  factors  deal  with  the  detection 
situation  up  to  the  sonar  display',  the  human, 
however,  is  an  integral  part  of  the  detection 
process,  and  the  human  factor  in  this  context 
is  as  important  as  the  other  factors  (but,  un¬ 
fortunately,  such  less  well  defined)  in  formu¬ 
lating  a  model  of  the  process.  The  "detection 
strategy"  esployed  by  the  sonar  operator  cer¬ 
tainly  involves  correlation  of  information 
across  severs*  nings ,  sc-  '-.hat  a  single  mark  on 
the  display  can  rarely  be  regarded  as  a  "false 
response"  oppoTr -aity-  This  strategy  aay  be 
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considered  in  the  context  of  the  asnel  signal 
detection  nodel  as  redscicg  the  nsaber  of 
opportunities  calculated  on  the  basis  of  in¬ 
dividual  pings,  or  it  can  be  naturally  ac- 
consodated  in  a  sequential  detection  ncdel. 

The  first  tvo  factors  can,  in  principle,  be  accurately 
specified  {for  an  experinent}  froa  the  electronic  character¬ 
istics  of  the  noise/reverberatien  source  and  the  sonar  set. 

The  hunan  factor  nentioned  above,  hcvever,  has  never  been 
thoroughly  investigated  for  coaplex  displays,  and  is  a 
ubiquitous  source  of  speculation  vherever  the  calculation  of 
false  response  probabilities  froa  experiaental  data  are  de¬ 
sired.  No  objective  nsans  exist  to  precisely  define  the 
effective  nnsber  of  false  response  opportunities  presented 
in  a  san-aachine  detection  systea  vith  coaplex  displays,  and 
there  are  nearly  as  aany  assuaptions  regarding  this  nnaber  as 
there  are  authors  reporting  experinental  results.  We  intend 
to  aake  another  such  assunption  here;  and  ve  caution  the 
reader  who  wishes  to  coapare  p{Fa)  for  various  es^srisssnts  to 
csrefully  study  each  expeTiaeater*s  "false  response  opportuai  ty 
assuaptions. 

Me  have  assuaed  that  there  were  lOG  opportunities  (per 
operator)  for  the  noise/reverberation  background  in  the  72 
six-ping  sequences  to  elicit  false  FM  contact  rep-orts;  and 
100  opportunities  for  the  72  sequences  to  elicit  false  CM 
contact  reports-  Me  justify  the  order  of  magnitude  of  these 
assuaptions:  in  the  following  way:  there  were  certainly  aore 
than  10  opportunities  in  the  72  sequences,  since  aore  than 
10  false  reports  were  nade  by  -tone  subjects  during  each 
session  (for  both  displays) ;  aad,  froa  oar  knowledge  of  the 
noise/reverberation  characteristics  and  the  detection  behavior 
of  the  operators,  we  are  convinced  that  there  were  fewer  than 
1000  opportunities  for  the  non-signal  infomation  to  stimulate 
contact  reports.  However,  we  do  not  intend  to  defend  the 
nunber  ”100"  over  the  nunber  "50,"  or  "200";  by  the  sane  token. 


we  donbt  that  aay  other  stsaeats  of  this  sitaatioa  will  feel 
ia  a  positios  t©  challenge  the  assr'atptiea  by  a  factor  this 
ssall. 


Based  oa  these  assoaptioas,  there  were  a  total  of  1800 
false  report  ©pportaaities  over  the  IS  operate rs  for  each 
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ent-on.  Thus, 
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COMMAXD 

ATTE35TI03i 

SIGE.AL 

TYTE 

buJiBER 

FALSE 

REPORTS 

GPPOR- 

TOKITIES 

?(Fa) 

Low 

FH 

S7 

ISOO 

.041 

High 

FM 

43 

1300 

.024 

Low 

at 

2S4 

1800 

.158 

High 

Of 

135 

1800 

.108 

Beeetpay  trpBTs.ti.ne  -^nzsrssteTistie.  Detection  and  false 
response  probahilities  are  often  joiatly  plotted  ia  a  forsat 
kaowa  as  the  *®recei^reT  operatiag  characteristic*’  (BOC) ,  with 
p(D3  on  the  ordinate  and  pC^i  ©a  the  abscissa.  The  proba¬ 
bilities  calcclated  ia  this  section  fron  the  eBcperiaeatal 
data  are  displayed  ia  the  ROC  forsat  ia  rigare  20.  The  axes 
ia  this  figure  are  aot  linear  ia  "probability,"  but  they  are 
linear  ia  the  "unit  aoraal  deiriates,”  or  "standard  scores," 
corresponding  to  the  probabilities  indicated  on  the  axes. 

This  property  is  useful  becaasc  the  usual  signal  detection 
theory  sodel  assunes  Gaussian  equal -variance  di stributions 
of  the  results  of  observations  under  noise  and  signal -plus- 
noise  conditions.  The  ontcose  of  this  assuisptioa  is  that  ia 
the  "aoraal -aorsal"  coordinate  systea  of  Figure  20,  the  locus 
of  all  operatiag  points  (i.e.,  pairs  of  probabiliticsj  ac¬ 
cessible  to  a  "receiving  syscea"  with  a  specific  detection 
efficiency,  or  "signal  detectability,"  d*,  describes  a 
stTsight  tine  parallel  to  the  "chance  diagonal"  shown  in  the 
figure,  which  is  the  locus  of  ta»  points  ©(D)  =  p(FR).  Each 
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Figure  20.  Receiver  Operating  Characteristic  (ROC)  showing 
experlisent  detection  perforaance  by  signal  type 
and  level  of  coiasand  attention. 
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Tespoads  ta  a  specific  xaise  ©f  tbe  ^ecectioa  cTicecios,  £- 
Tfess,  iCcoTOiag  te  tais  sKsdels  s  cfcsage  ia  acteccioa  critexioa 
3tasc  ao'we  fae  systea  opsTaaiag  ©oiaf  pss^Iisi.  t.ae  casacc 
siagoasi;  aad  t  caaage  ia  cffeccire  sifaal  decectability  siist 
HKSTe  tae  syster  opsxaciag  poiat  PS?p5siif©aI*reJ¥  to  tie  cbaace 
diagoaal .  {See  GTeea  asd  Sheets,  1966,  foT  a  detailed  esalaaa- 
^toa  ©t  stgaal  detectioa  tieo~y  ia  psyciopavsics-J 

It  caa  be  seea  froa  Figare  2D  that  tie  **iigb“  level  of 
copsaad  atteatioa  TOved  the  C¥  operating  point  avay  fron  tie 
operating  point  for  tie  "low"  ierel  ats^st  psrpendisularty 
to  the  chance  dtagonaZ,  ia  a  direction  of  isproved  effective 
signal  detectability;  aad  tie  displaceaeat  cf  tfee  FM  operating 
point  bad  approsinately  eqnal  conpoaents  of  pcrpeadicalar 
noveseat,  corresponding  to  inproved  detectability,  aad  parallel 
aoveseat,  corresponding  to  a  change  of  reporting  criterion  xn 
the  direction  of  increased  "caation.**  lhas,  in  the  context  of 
the  asaal  signal  detection  theory  nodcl,  the  principal  effect 
of  the  ”high"  level  of  connand  attention  acs  to  inprooa  systes 
perfoTmsnee  hy  -issproping  detection  eff-idency. 

This  conclusion,  however,  does  not  depend  upon  the  assuap- 
tion  of  the  usual  nathesatical  nodel  of  signal  detection.  Any 
reasonable  aodel  of  the  detection  process  would  have  to  attri¬ 
bute  improved  detection  efficiency  to  the  effects  of  the  "high®^ 
level  of  coaaand  attention  upon  the  operating  points  shown  in 
Figure  20,  conpared  to  the  "low"  level. 

The  Statist%cs  and  "g.®  In  the  signal  detection 

model  which  assumes  Gaussian  equal -variance  distribution^  of 
the  results  of  observations,  the  measure  of  signal  detect¬ 
ability  is  the  separation  of  the  means  of  the  noise-only  and 
signal -plus-noise  distributions  (along  the  axis  of  the  "test 
statistic"  random  variable)  in  units  of  the  common  standard 
deviation,  and  is  almost  universally  denoted  by  the  symbol 
"d'."  This  parameter  and  the  likelihood-ratio  decision  cri¬ 
terion,  denoted  by  the  symbol  "P,"  together  completely  specify 
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p(D}  aaa  p(FR),  throaga  the  satheiiatical  procedares  specified 
by  the  podei.  CosTersaly,  if  sa  expcriaeat  is  taoagbt  t©  be 
ideqaataly  described  by  this  sodel ,  the  experiaeatally  cbserred 
p(D}  aad  pfFS)  aay  be  ased  (tbroagh  iarerse  aatheaatical  pro¬ 
cedares)  ts  derive  d'  aad  B  for  taat  detectioa  sitaatioa. 
At-te^nstivsly ,  d’  astd  S  aag  be  fjr^ss  espeTiss^tallg 

ohseTTPed  p(D)  and  pfFS)  ihrough  these  pToced^es,  to  he  used 
soleZy  as  dessTiptiue  ststi.sti.ss,  vitboat  aa  applied  eadorse- 
seat  of  the  appropriateaess  of  the  aaderlyiag  aathaaatical 
^del.  This  espirical  ase  of  d'  aad  S  as  descriptive  statis¬ 
tics  is  both  asefal  (ia  describiag  the  joint  effects  of  caaages 
ia  detectioa  and  false  response  probabilities)  and  very  wide¬ 
spread  in  the  literature  of  detection  experiments.  It  is  in 
this  latter  sense  that  we  calculate  d'  and  B  for  this  experi¬ 
ment,  since,  as  we  discussed  in  the  first  chapter,  we  doubt 
that  the  simple  Gaussian  equal -variance  sodel  is  the  sost 
appropriate  one  for  the  sonar  detection  task. 

A  convenient  table  for  calculating  d'  aad  B  from  experi¬ 
mentally  observed  proportions  p{S)  and  ?(Fk)  is  given  by 
Hochhaus  (1972),  and  was  esployed  to  calculate  the  following 
values: 

COMMAND  SIGN.AL 

ATTENTION  TYPE  d'  B 


Low 

FM 

1.09 

3.32 

High 

FM 

1.47 

6.95 

Low 

CM 

0.69 

1.57 

High 

CM 

1.13 

2.11 

It  can  be  seen  that,  on  the  average,  signal  detectability  was 
greater  for  the  FM  signals  than  the  CW;  and  that  aorc  "strict" 
reporting  criteria  (i-e.,  larger  values  of  B)  were  eaployed 
for  FM  signals  than  for  CW.  It  is  also  seen  that  tl ^  "high" 
level  of  connand  attention  brought  about  a  55%  inproveaent  in 
FM  signal  detectability,  and  a  64%  iaproveaent  in  CM  signal 
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detectability,  compared  to  performance  at  the  "low"  level. 

The  reporting  criterion  concomitantly  increased  by  109%  in 
the  direction  of  "caution"  for  FM  signals,  and  by  34%  for 
CK  signals. 

Relationship  of  Attitude  Toward  “False  Contact  Consequence" 
to  numbers  of  False  Reports  Actually  Made 

In  Chapter  II  we  discussed  the  diversity  with  which 
officers  and  sonar  operators  rank  ordered  the  tactical  scenar¬ 
ios  regarding  false  contact  consequences.  The  questionnaire 
portion  of  that  survey  instrument  and  the  rank  ordering  task 
with  respect  to  false  contact  consequences  were  administered 
to  the  sonar  technicians  who  served  as  subjects  in  the  detec¬ 
tion  experiment,  to  permit  comparison  of  their  responses  to 
those  of  the  219  men  sampled  in  the  survey.  These  tasks  were 
administered  at  the  end  of  each  operator's  last  experimental 
session,  via  the  instructions  shown  in  Appendix  G. 

The  cf  che  operators  to  the  questionnaire  were 

not  significantly  different  from  those  obtained  in  the  main 
survey.  They  were  also  asked  a  supplemental  question  concern¬ 
ing  the  similarity  of  the  experimental  stimuli  to  the  A-scan 
display  of  their  own  sonars.  None  of  the  operators  indicated 
that  the  stimuli  were  significantly  different  from  the  display 
with  which  they  were  familiar. 

The  ranking  task  was  administered  to  permit  examination 
of  the  potential  relationship  between  attitudes  toward  false 
contact  consequences  and  actual  false  reporting  behavior 
during  the  detection  experiment.  The  behavioral  criterion 
to  be  used  in  this  comparison  is  obviously  the  number  of  false 
reports  made  by  each  subject.  The  attitudinal  criterion  to  be 
compared  with  the  number  of  false  reports,  however,  is  not  so 
evident.  The  attitude  data  for  each  operator  consisted  of  the 
rank  order  in  which  he  placed  the  17  scenarios  in  relation  to 
the  consequences  of  false  alarms;  we  wished  to  derive  a  single 
descriptive  statistic  from  these  ranks,  to  be  compared  with 


89 


the  number  of  false  reports  that  the  operator  made.  This 
statistic  was  derived  for  each  operator  by  comparing  his 
rank  ordering  of  the  scenarios  with  the  rank  ordering  shown 
in  Figure  5,  which  was  derived  by  scaling  the  rankings  of 
the  119  officers  and  sonar  technicians  in  Group  I  who  judged 
false  contact  consequences  to  be  worst  for  wartime  scenarios. 

The  scenarios  in  Figure  5  have  been  assigned  scale 
values,  derived  by  the  variability  judgment  technique  dis¬ 
cussed  in  Chapter  2.  The  responses  of  a  single  individual, 
however,  cannot  be  assigned  scale  values,  because  the  scaling 
technique  depends  upon  variability  in  responses  among  sevevat 
judges.  Therefore,  we  could  not  use  the  scale  values  shown 
in  Figure  5  in  any  comparison  to  individual  rankings  per¬ 
formed  by  the  operators  who  participated  in  the  experiment, 
which  contain  only  ordinal  information.  Consequently,  we 
determined  the  similarity  of  the  rarik  order  of  the  scenarios 
shown  in  Figure  5  with  the  rankings  performed  by  each  of  the 
IS  op«'rators  in  the  detection  experiment,  by  calculating 
Spearman's  rank  correlation  coefficients. 

Thus,  we  obtained  an  attitudinal  criterion  for  each 
operator,  which  reflects  a  comparison  of  his  attitudes  toward 
false  contact  consequences  with  the  ^’Group  I”  attitude  (that 
false  contact  consequences  are  worst  in  wartime  situations')  . 

If  the  rank  correlation  coefficient  calculated  for  an  operator 
were  near  +1.00,  it  would  indicate  that  his  rank  ordering  was 
very  close  to  that  shown  in  Figure  5,  and  that  he  was  probably 
a  "member"  of  Group  I.  If  the  rank  correlation  coefficient 
were  near  -1.00,  it  would  indicate  that  his  rank  ordering  was 
nearly  opposite  to  that  shown  in  Figure  5  (i.e.,  very  close 
to  that  shown  in  Figure  6) ,  and  that  he  was  probably  a  "member" 
of  Group  II,  which  judged  false  contact  consequences  to  be 
least  severe  during  war.  If  the  correlation  coefficient  were 
near  zero,  it  would  indicate  that  there  is  little  correspon¬ 
dence  between  his  rank  ordering  and  those  of  either  Group  I 
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or  Group  II,  placing  him  in  the  Group  III  attitude  category. 

The  total  number  of  false  reports  which  each  subject 
made  during  the  "high"  command  attention  condition  is  shown 
in  Figure  21  plotted  against  the  corresponding  rank  correla¬ 
tion  coefficient.  Each  point  in  this  figure  thus  character¬ 
izes  an  individual  operator's  false  reporting  behavior,  and 
his  "false  contact  consequence"  attitudes. 

It  was  found  that  amount  of  experience  with  the  AN/SQS-26 
sonar  was  an  important  factor  in  the  distribution  of  points 
in  Figure  21.  Two  operators  informed  us  that  their  primary 
duties  involved  the  maintenance  of  fire-control  equipment, 
and  that  they  had  no  experience  with  the  .AN/SQS-26  A-scan  dis¬ 
play.  These  operators  made  very  fe\ir  false  or  correct  reports 
during  the  experiment,  reflecting  an  atypical ly  conservative 
reporting  behav.lor  which  was  no  doubt  the  result  of  their  un¬ 
familiarity  with  the  stimuli.  Therefore  we  discount  the  data 
points  in  Figure  21  (denoted  by  the  symbol  "X")  corresponding 
to  these  operators.  (The  inclusion  of  these  operators  was 
found  to  have  negligible  impact  on  the  other  results  reported 
in  this  chapter,  so  this  is  rhe  only  analysis  from  which  they 
were  excluded.) 

Of  the  remaining  16  operators  (whose  primary  duties  did 
involve  operating  the  AN/SQS-26  sonar) ,  6  had  less  than  a 
year  of  experience  with  the  sonar,  and  10  had  a  year  or  more 
of  experience.  Figure  21  shows  that  there  was  a  tendency  for 
the  less  experienced  operators,  whose  data  points  are  indi¬ 
cated  by  open  circles,  to  make  more  false  reports  than  the 
more  experienced  group,  whose  data  points  are  indicated  by 
closed  circles. 

The  figure  also  reveals  a  tendency  toward  making  fewer 
false  reports  by  the  operators  who  felt  that  wartime  false 
contact  consequences  were  worst  (i.e.,  those  operators  toward 
the  right  end  of  the  scale).  The  dotted  line  in  the  figure 
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is  a  least-squares  "best  fit"  to  the  data  points  for  operators 
with  one  or  more  years  of  exoerience  with  the  sonar,  and  the 
Pearson  correlation  coefficient  between  the  numbers  of  false 
reports  and  the  "attitude"  statistics  for  this  group  was 
-0.92,  which  is  a  very  significant  value  even  for  this  small 
number  of  operators  (p  <  .001).*  The  data  points  for  the  less 
experienced  operators  fall  above  this  regression  line  (with 
one  exception) . 

These  data  support  the  expectation  that  those  operators 
who  judged  wartime  false  contact  consequences  to  be  wopst  would 
make  fewer  false  reports  daring  the  "high"  command  attention 
condition.  We  cannot  regard  these  data  as  conclusive,  however, 
because  of  the  limited  sample  size,  and  particularly  because 
the  sample  (through  the  unfortunate  medium  of  chance)  clustered 
toward  the  right  end  of  the  "attitude"  scale. 


* 

It  is  recognized  that  one  operator  who  evidently  considered 
false  alarms  quite  inconsequential  contributed  heavily  to 
this  correlation. 


CHAPTER  IV 


CONCLUSIONS 

Many  detailed  conclusions  have  already  been  drawn  in  the 
text  of  this  report,  in  conjunction  with  the  exposition  of 
specific  results.  It  is  hoped  that  the  reader  will  find  in 
these  specific  results  cause  for  further  conclusions,  and 
we  hope  that  the  many  details  which  have  been  presented  will 
facilitate  that  use  of  the  research  results. 

However,  in  this  chapter  we  wish  to  step  back  from  the 
myriad  technical  details  of  psychometrics,  statistics,  signal 
detection  theory,  and  so  forth,  to  view  the  research  in  a 
more  comprehensive  perspective.  In  the  first  sentence  of  the 
first  chapter  of  this  report,  we  stated  that  "it  is  necessary 
for  the  Kuvy  to  make  quantitative,  detailed,  and  accurate 
estimates  of  expected  performance  in  a  wide  range  of  threat 
situations,  and  particularly  in  accomplishing  its  potential 
wartime  missions." 

We  hope  to  accurately  interpret,  in  an  integrated  manner, 
the  implications  of  this  research  concerning  the  expected  per¬ 
formance  of  our  destroyers  in  accomplishing  their  potential 
ASW  missions. 

Noise j  Reverberation,  and  "False  Contacts" 

Most  theoretical  and  laboratory  studies  of  signal  detec¬ 
tion  focus  upon  the  task  of  differentiating  a  "signal-plus- 
noise"  condition  from  a  "noise-alone"  condition;  indeed,  this 
task  defines  what  is  usually  meant  by  "signal  detection."  An 
extensive  theoretical  framework  has  been  built  around  this 
detection  situation,  and  many  experiments  have  been  performed 
involving  the  human  as  the  "detector,"  laying  a  theoretical 
and  empirical  foundation  which  has  permitted  us  to  conduct  a 
meaningful  sonar  detection  experiment,  and  analyze  the  sonar 
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operator's  detection  behavior  in  response  to  operationally 
isportant  variables. 

However,  an  extremely  important  practical  distinction 
exists  between  the  "typical"  laboratory  detection  task  and 
the  actual  active  sonar  detection  situation-  In  the  "pure" 
detection  task,  performance  is  generally  accompanied  by 
"valid"  detections,  stimulated  by  the  "signal-plus-noise" 
condition,  and  "false"  detections,  stimulated  by  the  "noise- 
alone"  condition.  In  any  non-trivial  detection  task  of  this 
type,  the  "noise"  background  will  be  a  significant  source  of 
false  responses,  and  this  potential  for  the  noise  to  elicit 
detection  responses  is  crucial  to  the  underlying  mathematical 
model  of  signal  detection.  In  the  sonar  detection  experiment 
described  in  Chapter  III,  all  false  responses  mere  stimulated 
by  the  sonar  noise/reverberation  background,  permitting  the 
application  of  signal  detection  theory  techniques  to  analyze 
the  influence  of  the  independent  variables  upon  sonar  opera¬ 
tors'  reporting  behavior,  the  determination  of  which  was  the 
sole  objective  of  the  experiment - 

However,  in  the  operational  sonar  detection  situation, 
the  noise/revexberation  background  is  an  utterly  insignificant 
source  of  "false"  responses,  compared  with  that  unfortunately 
large  class  of  objects  which  give  rise  to  "false  contacts." 
"False  contacts"  produce  reaZ  echoes,  whose  characteristics 
differ  significantly  from  the  noise  background  fand,  often, 
insignificantly  from  "valid"  target  echoes).  The  true  noise 
and  reverberation  background  is  always  uncorrelated  over  a 
time  interval  of  several  pings,  and  can  therefore  produce 
consistent  marking  of  the  sonar  display  at  a  given  location 
only  with  vanishingly  small  probability;  the  "false  contact," 
however,  persists,  and  is  reported.  Thus,  the  noise/reverbera¬ 
tion  background  as  a  source  of  false  reports  leading  to 
seriousay  inappropriate  tactical  responses  is  one  of  the  few 
minor  problems  which  confront  destroyer  ASW. 
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We  are,  of  course,  talking  about  the  classification 
problem.  One  cannot  criticize  signal  detection  theories  or 
experiments  for  not  dealing  with  classification  (i.e.,  the 
task  of  distinguishing  one  signal  from  another,  rather  than 
signal-plus-noise  from  noise  alone),  since,  by  definition, 
it  is  not  in  their  domain  to  do  so.  By  the  same  token,  how¬ 
ever,  it  is  almost  by  definition  impossible  to  meaningfully 
discuss  destroyer  ASW  without  considering  the  classification 
problem. 

“Classification  continues  to  be  the  most  pressing 
problem  in  ASW."  A  Chief  Sonar  Technician  whom 
we  interviewed. 

"Classification  continues  to  be  the  biggest 
problem."  A  Destroyer  ASK  Officer. 

"I  believe  rapid  classification  is  still  the 
major  problem  in  command  and  control  in  ASM." 

A  Destroyer  Commanding  Officer. 

False  Contacts:  The  High  Threshold  Solution 

Without  false  contacts,  of  course,  there  would  not  be 
any  classification  problem.  The  fact  is,  however,  that  the 
oceans  contain  many  more  "things"  that  look  like  submarines, 
to  a  sonar,  than  there  are  submarines;  and  as  we  continue  to 
trade  cue  resolution  r  longer  ranges  in  our  newer  sonars, 
these  "things"  look  a  j  like  submarines  than  ever  before. 
The  peacetime  solution  to  this  high  incidence  of  false  tar¬ 
gets  is  simple  and  well-known: 

"When  returning  from  a  cruise,  whether  long  or 
short,  it  is  common  practice  for  sonar  to  get 
the  unofficial  word  'NO  CONTACTS.'  If  sonar 
should  report  a  contact  during  this  time, 
whether  sub  or  not,  sonarmen  will  not  get  a 
'KELL  DONE.'  Hence,  reporting  during  this 
period  is  almost  non-e:<istent ,  unless  the  sub¬ 
marine  forces  a  report,  by  surfacing  1,000 
yards  away  for  example."  A  Chief  Sonar  Tech¬ 
nician. 
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"Although  ASW  is  the  priaary  aission  of  a 
destroyer,  1  have  found  that  the  present-day 
officers  on  the  bridge  have  little  or  no  in¬ 
terest  in  the  prosecution  of  a  sonar  contact, 
be  it  possible,  or  non-sub,  during  any  under¬ 
way  period,  excep ;  an  ASW  exercise.  ...Re¬ 
marks  like  'turn  four  gain  down,  and  it  will 
go  away,*  or  *we  have  something  more  important 
to  do'  [account  for  decreased  contact  report¬ 
ing]."  Another  Chief  Sonar  Technician. 

This  attitude  from  the  bridge-  hus  the  effect  of  raising  sonar's 
reporting  threshold  to  a  high  value--thcy  report  contacts  only 
when  very  confident.  However,  it  is  not  true  that  all  ofricers 
share  this  lack  of  interest  in  prosecuting  contacts,  or  think 
the  "high  threshold"  solution  to  false  contacts  is  a  good  one: 

"In  general,  the  practice  has  been  to  report 
only  if  you  are  sure  of  a  contact  (especially 
in  a  situation  where  you  are  being  evaluated) . 

I  believe  the  sonar  team  must  be  encouraged  to 
report  immediately  any  contact,  especially 
with  the  advent  of  the  sophisticated  sonar  in 
use  today.  The  need  for  immediate  response 
precludes  the  accumulation  of  'pings*  in  order 
to  have  a  firm  evaluation  prior  to  reporting  a 
contact  to  ship  control.  The  requirement  for 
sonar  to  report  any  and  all  contacts  immediately 
must  be  stressed  in  order  for  the  unit  to  take 
the  necessary  action  to  maintain  and  prosecute 
a  contact."  A  Destroyer  Executive  Officer. 

"False  contacts,  in  general,  are  not  nearly  the 
problem  that  fewer,  or  no  contacts  are.  I  feel 
that  in  most  cases,  low  confidence  contacts  de¬ 
serve  more  investigation  than  they  customarily 
receive."  A  Destroyer  Commanding  Officer. 

"Aggressiveness  cannot  be  sacrificed  at  the 
expense  of  legitimacy.  I  don't  feel  the  false 
contact  rate  is  so  detrimental,  as  training  and 
practice  are  gained  by  initial  classification. 

Bridge  watches  should  heed  sonar  more  often. 

The  bridge  is  too  often  concerned  about  'stick¬ 
ing  out  its  neck. *  The  only  way  contacts  can 
be  gained  is  by  reporting  and  prosecuting." 

A  Destroyer  Operations  Officer. 

Nonetheless,  it  is  very  apparent  even  from  these  comments 
that  the  peacetime  reporting  threshold  is  a  high  threshold. 
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The  scaling  of  17  peacetiae,  ASK  exercise,  ans?  wartise  sce¬ 
narios  Of  our  saaple  of  S9  destroyer  officers  and  ]i9  sonar 
technicians  according  to  "certainty  net-essary  for  reporting” 
clearly  indicates  that  such  aore  confidence  in  a  sonar  con¬ 
tact  is  required  to  elicit  a  report  daring  pcacetine  non-ASH 
operations  (set  Figure  3).  Sc  nay  also  conclude,  froa  the 
results  of  the  detection  experiaent,  that  “he  typically  "los” 
level  of  couaand  attention  focused  upon  peacetiae  sonar  detec¬ 
tion  perforaance  brings  iboc“  a  decrement  in  detection  effi¬ 
ciency,  or  "effective  signal  detectability." 

The  consequence  of  this  high  threshold,  los  detection 
efficiency  node  of  operation  is  to  screen  out  false  (and 
valid)  contacts  at  the  lowest  hierarchical  le.-tl,  -elieving 
the  rest  of  the  teaa  (CIC,  U3,  and  conaani)  of  the  burden 
and  the  expein-ence  of  the  ASS  decision-aaking  process.  In 
tiac  of  war,  however,  that  burden  is  going  to  shift. 

The  Wartime  Threshold:  ’’Report  Svervthina” 

"When  you* re  in  a  tiae  of  var — speaking  for 
ayself,  I  vould  be  scared  as  hell  and  probably 
report  nore  contacts...".  An  STG3  Sonar 
Operator. 

"Obviously,  acre  false  contacts  will  occur  in 
wartiae  due  to  the  fact  that  sonarnen  will, 
and  should  be,  less  reluctant  to  call  and 
classify  a  contact."  A  Destroyer  ASM  Officer. 

"Sill,  and  should  be,  less  reluctant...":  a  predictive,  and 
a  nersative  stateaent.  Se  agree  with  both.  The  scaling  of 
scenarios  with  respect  to  "certainty  necessary  for  reporting" 
(Figure  3) ,  shows  the  wartiae  scenarios  to  be  in  a  class  by 
thensel ves--far  reaoved  froa  the  other  scenarios  in  the  direc¬ 
tion  of  a  very  "free"  reporting  threshold.  Likewise,  scaling 
of  the  saae  scenarios  with  respect  to  "aissed  contact  conse¬ 
quences"  (Figure  4)  and  with  respect  to  "consequences  of  de¬ 
layed  contact  reporting"  (Figure  10)  indicates  consequence 
evaluations  which  will  result  in  a  very  low  reporting  threshold. 
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There  is  reaarkable  agreesent  between  officers  and  sonar  opera¬ 
tors  Csad  junior/seaior  personnel,  and  LAXTFLT/PACFLT  groups) 
in  their  responses  to  our  interviews,  and  they  indicate  aucb 
**freer"  reporting  in  tine  of  sar. 

Se  agree  that  the  wartise  reporting  threshold  shoutd  be 
low  for  the  obvious  reason  that  the  dctection/classification/ 
attack  sequence  nust  be  a  group/hierarchical  process  with 
naxinun  inforsation  flow  to  the  top ^  where,  in  tine  of  war, 
the  decision  ssust  be  aade.  Tliere  is  no  way,  theoretically  or 
practically,  to  sake  optisal  decisions  by  arbitrarily  restrict¬ 
ing  infOTSsatios  flow  froa  the  priuary  sensor,  particularly  in 
the  infomation-starYed  ASW  environscnt. 

Of  course,  this  is  going  to  give  rise  to  a  considerable 
probles  on  the  bridge. 

Tke  Decision  Probtas 


Half  the  sen  in  our  survey  sanple  who  estiuated  wartise 
deepwater  false  contact  rate  expected  sore  than  10  false  con¬ 
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tacts  per  day.  What  is  the  uagnitude  of  the  isplied  decision 
problea?  The  reader  fasiliar  with  ASs  xcrcise  results  say 
detect  the  ring  of  unrealistic  optiaisa  in  this  coasanding 


s  coasent : 


”If  equal  action  is  assused  for  each  false 
coat.:ct,  t- are  would  be  a  very  Sv^icus  prooiea- 
X  an  assuning  that  proper  oaiuation  by  taa 
teas  will  evaluate  9QS  or  sore  of  the  false 
contacts  as  false  >~e-atacts  and  that  cniy  a 
snail  nunber  will  result  in  firing  or  leaving 
the  screen,  etc-*’  A.  Destroyer  Coanaading 
Officer. 

this  destroyer  executive  officer  puts  it: 

"in  a  wartisc  situation,  i  would  expect  the 
old  problea  of  expenditure  of  ordnance  on 
false  contacts  to  repeat  itself." 

problea,"  however,  is  aore  of  a  problea  than  e 
weapons  arc  greater  in  cost  and  fewer  irs  auuber 
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because  the  fast  nuclear  subaarine  target  forces  the  necessity 
of  such  quicker  response  upon  us,  ifith  an  attendant  higher 
probability  of  attacking  false  targets,  and  lo^er  probability 
of  detecting  jad  attacking  real  ones. 

.4nd  to  sake  the  AS^  decision  probles  sore  cospiex  and 
unpredictable,  we  have  found  that  the  decision  aakers  take 
widely  divergent  views  concerning  false  contacts.  In  rank¬ 
ing  the  17  scenarios  according  to  consequences  of  false 
contacts,  55%  of  the  sasple  ("Group  I”)  were  very  such  in 
agreeaent  aaoag  thesseives  in  ranking  the  wartise  false  con¬ 
tact  consequences  worst  (Figure  5).  On  the  other  hand,  2S% 
of  the  sanplc  ("Group  II")  took  a  coapletcly  opposite  view 
of  false  contact  consequences,  considering  false  contact  con¬ 
sequences  'i&ast  severe  daring  war  (Figure  6)  .  The  Pearson 
correlation  coefficient  between  the  scenario  scale  values  of 
Group  1  and  Group  11  was  sinus  0. 972--alsost  perfect  airror 
isages.  Then,  there  is  Group  IIl--a  group  coaprising  17% 
of  the  saaplc,  consisting  of  officers  and  operators  in  aisost 
cocplete  disagreeaent  aaong  thessclves,  and  with  respect  to 
the  other  groups,  concerning  the  consequences  of  false  contacts 


It  is  likely  that  a  person’s  views  of 
sequences  will  have  an  effect  upon  his  dec 
>ce  an  -..•tfcct  on  our  •■contact  reporting 


false  contact  con- 
ision-naking  behaifior 
threshold"  scale 


whan  Group  I  and  Group  II  are  independently  plotted  (Figure  S3, . 
Those  who  feel  false  contacts  are  least  significant  daring  war 
(i.e..  Croup  II)  are  seen  to  advocate  a  greater  change  in 


"reporting  threshold"  froa  peace  to  war  than  do  the  nsabers 
of  Group  I.  Since  each  subject  was  required  to  rank  the  sce¬ 
narios  according  to  "reporting  criterion"--i-e. ,  confidence 
necessary  to  report --before  he  was  required  to  rank  then  with 
respect  to  false  contact  consequences,  he  say  not  have  ex¬ 
plicitly  taken  into  account  his  feelings  toward  false  contacts 
while  responding  on  the  foraer  scale.  That  is,  the  effect  of 
the  Group  I/Group  II  differences  on  the  "reporting  threshold" 
scale  aay  be  conservative. 
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We  also  see  a  relationship  between  the  false  contact 
consequence  attitudes  of  the  sonar  operators  who  participated 
in  the  detection  experiuent,  and  the  nuabers  of  false  reports 
which  they  sade  I'Figure  21).  It  is  also  probable  that  atti¬ 
tudes  will  influence  officers’  decision-uaking  perforaance. 

Analysis  of  the  survey  data  shows  no  way  to  predict 
subjects’  seabership  in  Group  i,  11,  or  III  froa  the  personal 
data  collected.  Ho  group  had  a  aeabership  which  was  charac¬ 
teristically  officer,  enlisted,  LANTFLT,  PACFLT,  "aore  ex¬ 
perienced,"  "less  experienced,"  or  coaposed  of  coaaanding 
officers.  It  follows  that  whatever  influences  the  attitudes 
of  Groups  I,  II,  and  III  have  on  decision-nafcing  behavior  in 
ASW  are  now  distributed  unpredictably .  (It  is  probable,  how¬ 
ever,  that  these  variances  c-..  be  uiniRized  through  training 
and  procedural  isplesentaticns.} 

In  sasaary,  it  seess  likely  that  at  the  onset  of  war, 
the  naturally  large  nuaber  of  objects  which  can  cause  false 
contacts,  the  greater  wartine  inclination  for  the  sonarsen 
to  detect  and  report  then,  and  the  inexperience  of  the  rest 
of  the  1:11  dealing  with  then  (and  their  heterogeneous 

attitudes  toward  then)  will  constitute  a  very  serious  ASK 
decision  probiea. 

Tha  Equitibi^io'’  State 

Ke  have  concluded  that  the  peacctiue  destroyer  ASK  posture 
is  often  one  of  low  connand  attention,  low  d  tecCion  efficiency 
and  of  coEparstivcly  "reluctant"  scjsar  contact  leporting  be¬ 
havior;  and  we  have  concluded  that  at  the  onset  of  an  ASK  war, 
the  pcndulun  will  swing  to  the  opposite  extrese.  The  latter 
condition,  however,  will  necessarily  be  a  transient  state. 

Sonar  contact  detection,  reporting,  prosecution,  and  attack 
cannot  long  continue  in  a  raspant  sanner;  we  will  not  be  able 
to  "classify"  every  contact  with  a  weapon.  Historical  evidence 
indicates  that  after  souc  period  of  tine,  a  tolerable  ratio  of 


false  to  valid  attacks  Kill  be  achieved  (Buchanan  and  Freilich, 
1971).  But,  how  will  this  "equilibriuia  state"  be  effected? 

Ke  fear  that  unless  destroyer  officer  personnel  appreciate 
the  ASH  problea  in  its  fullest  extent,  particularly  including 
the  sonar  operator* s  vary  difficult  task,  apparent  coa=and 
dissatisfaction  with  the  "transient  state"  detection  and  clas¬ 
sification  perforaance  will,  intentionally  or  uaintent ioually, 
influence  the  sonaz  operator  toward  undesirably  conservative 
detection  behavior-  And  it  is  a  discouraging  fact  that  very 
aany  destroyer  connanding  officers  have  been  provided  with 
very  little  ASK  training  or  practical  experience- 

The  equilibriua  state  aust  not  be  achieved  by  the  strangu¬ 
lation  of  sensor  inforsation  at  the  sonar  operator’s  level, 
inadvertently  or  otherwise;  it  will  ideally  be  achieved  on 
board  each  destroyer  through  the  inforaed  decisions  of  a  con- 
petent,  professional  ASH  teoia.  In  order  to  attain  this  ideal, 
it  scccs  that  we  3ust  begin  to  treat  surface  ship  ASH  as  the 
desanding,  highly  technical,  highly  specialized  discipline 
that  it  is,  and  begin  to  develOj/  significant  nusbers  of  Saval 
officers  who  have  been  given  the  thorough  training  which  that 
discipline  deaands ,  as  aany  of  the  other  iaportant  navies  have 
already  done.  A  detailed  diagnosis  and  prescription  regarding 
this  natter  is  given  fay  Mackie  (1972). 

In  the  aeantise,  the  search  reportcu  here  leaves  us 
with  questions,  as  research  usually  df.es.  How  vz.'^  i  the 
decision-saking  behavior  of  today’s  dfstroycr  officer  be  in¬ 
fluenced  at  the  onset  of  .ASH  war,  and  how,  in  turn,  will  he 
influence  the  sonar  operator’s  decision  behavior,  in  passing 
to  the  equilibriun  state?  He  are  presently  seeking  answers 
to  those  questions. 
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1.  REFRESHER  TRAIxNING 


Your  ship  is  undergoing  refresher  training  at  GITMO 
just  after  having  completed  a  three-month  shipyard  overhaul. 
There  are  no  other  ships  in  company.  Your  ship  is  conduct¬ 
ing  damage  control  and  engineering  exercises. 


2.  UNI DENT 

You  are  operating  in  the  Sea  of  Japan  (or  in  the  Med.) 
in  company  with  an  ASW  group.  Ships  in  company  include  a 
CVS  and  8  destroyers.  One  of  the  fixed-wing  aircraft  from 
the  carrier  has  reported  a  disappearing  radar  contact  20 
miles  ahead  of  the  task  group.  Helicopters  have  been  dis¬ 
patched  from  the  aircraft  carrier  and  are  presently  in  the 
contact  area.  The  helos  are  reporting  intermittent  sonar 
contact.  Your  ship  and  one  other  destroyer  have  been  de¬ 
tached  to  proceed  to  the  contact  area. 
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3.  WARTIME  MERCHANT  CONVOY 


Your  ship  is  one  of  six  destroyers  screening  for  a 
SO-ship  merchant  convoy  steaming  in  a  nuclear  defense  dis¬ 
position,  transiting  from  Halifax,  Nova  Scotia  to  Glasgow, 
Scotland.  A  state  of  war  has  existed  between  the  NATO 
countries  and  the  Soviet  alliance  for  a  period  of  one 
month.  The  convoy  you  are  with  is  the  third  convoy  to 
make  the  west/east  North  Atlantic  crossing  since  the  begin¬ 
ning  of  the  war.  The  first  convoy  made  the  transit  without 
incident.  The  second  convoy  encountered  light  opposition, 
losing  four  merchant  ships.  Intelligence  reports  indicate 
that  several  So’/iet  submarines  are  operating  in  the  North 
Atlantic.  Some  of  these  submarines  are  known  to  be  equipped 
with  cruise  (anti-shipping)  missiles.  The  range  of  these 
missiles  is  about  30  miles. 


4.  REFRESHER  TRAINING 


You  are  undergoing  ASW  refresher  training  in  the  GITMO 
op  area.  You  have  been  operating  with  a  submarine  for  the 
past  several  hours  bu^’  have  not  held  contact  for  some  time, 
an  hour  or  more. 
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5.  DEPLOYMENT  TRANSIT 

You  are  heading  overseas  at  the  beginning  of  what 
will  be  a  7-month  deployment.  Ships  in  company  include  an 
aircraft  carrier,  an  oiler,  and  three  other  destroyers. 
There  are  no  known  submarines  operating  in  the  area. 


6.  ANNUAL  COMPETITIVE  EXERCISE 

You  are  conducting  your  annual  competitive  exercise 
for  the  .ASW-E.  You  are  in  company  with  two  other  destroyers 
two  helicopters,  and  two  fixed-wing  aircraft.  At  the  be¬ 
ginning  of  the  exercise,  there  is  a  submarine  positioned  at 
a  point  12  miles  ahead  of  the  destroyers.  At  COHEX,  the 
submarine  submerged  and  is  making  an  approach  on  the  des¬ 
troyers.  In  order  to  pass  the  exercise,  the  destroyers 


must  detect  and  successfully  attack  the  submarine. 


7.  OPPOSED  SORTIE  EXERCISE 


You  are  getting  underway  from  your  home  port  to  partici¬ 
pate  in  a  major  fleet  exercise.  You  know  that  your  sortie 
will  be  opposed  by  at  least  two  submarines.  Your  ship’s 
assignment  is  to  clear  the  harbor,  proceed  to  a  previously 
assigned  patrol  area,  and  to  search  that  area  until  the  other 
exercise  units  have  cleared  the  harbor.  Once  the  other  units 
have  cleared  the  harbor,  you  will  fcrra  a  screen  around  them 
and  proceed  tc  sea.  Your  job  is  to  prevent  the  “enemy" 
submarine  from  obtaining  a  firing  position  on  the  screened 
units . 


8.  STEAMING  AT  NIGHT  IN  A  LOCAL  OP  AREA 

You  are  standing  the  raidwatch  on  a  ship  steaming  inde¬ 
pendently  in  a  local  op  area.  You  have  spent  the  week  at 
sea  conducting  gunnery  and  seamanship  exercises  and  will  be 
conducting  a  gunnery  exercise  in  the  morning  prior  to  re¬ 
turning  to  port. 
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9.  WARTIME  STRIKE  OPERATIONS 


A  state  of  war  exists  between  the  U.  S.  and  Communist 
China.  You  are  steaming  in  company  with  a  fast  carrier 
strike  group  operating  in  EMCON,  Condition  2  (no  electronic 
emissions  other  than  sonar) .  The  mission  of  your  task  group 
is  to  conduct  a  surprise  raid  on  China's  coastal  defenses. 

No  enemy  activity  has  been  reported  on  the  task  group’s  ECM 
equipment  and  airborne  early  warning  aircraft  operating  in 
advance  of  the  task  group  have  not  reported  any  enemy  activ¬ 
ity.  The  probability  is  that  your  task  group  has  not  yet 
been  detected  by  the  enemy.  Your  task  group  is  now  in  a 
position  200  miles  east  of  the  northern  tip  of  Luzon,  pro¬ 
ceeding  toward  the  Chinese  mainland.  There  have  been  no 
reports  of  enemy  submarine  activity  in  this  part  of  the 
Pacific  for  the  past  several  days. 


10.  UNIDENT 

You  are  in  port  overseas  when  word  is  received  that  an 
unidentified  submarine  has  been  sighted  operating  in  the 
vicinity.  Your  ship  and  one  other  destroyer  get  underway 
to  investigate.  The  original  sighting  was  made  by  a  U.  S. 
patrol  aircraft  and  the  DATUM  is  considered  accurate  to 
within  2  miles.  The  contact  was  held  by  the  aircraft  for 
5  minutes  and  then  lost  and  not  regained.  You  arrive  on  the 
scene  30  miles  from  the  port  4  hours  after  the  contact  was 
originally  reported. 
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11. 


WARTIME  SCREENING  FOR  AN  AMPHIBIOUS  TASK  GROUP 


Your  ship  is  one  of  12  destroyers  screening  for  a  fast 
aaphibious  task  group.  In  addition  to  the  amphibious  forces 
present,  your  movement  group  is  being  supported  by  a  CVA 
and  a  CVS.  The  CVA  and  CVS  are  operating  in  a  support  posi¬ 
tion  50  miles  on  the  flank  of  the  amphibious  group.  The 
mission  of  your  task  force  is  to  effect  a  landing  on  mainland 
China.  Although  a  state  of  war  has  existed  between  the  U.  S. 
and  Red  China  for  a  period  of  2  months,  the  Soviet  Union  has 
remained  neutral.  However,  the  Soviet  Union  has  threatened 
to  enter  the  war  if  the  U.  S.  should  attempt  a  landing  on 
mainland  China.  Present  position  of  your  task  group  is  200 
miles  east  of  Okinawa  headed  toward  mainland  China. 


12.  STEAMING  IN  A  LOCAL  OP  AREA. 
ACTING  AS  A  NIGHT  PLANE  GUARD 
DURING  CARRIER  AIR  OPERATIONS 


Ships  in  company  are  the  aircraft  carrier  and  one 
other  destroyer.  There  are  no  Inown  submarines  operating  in 
the  area. 
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CONDITION  III,  STEAMING  OVERSEAS 


You  are  steaoing  in  Condition  III  in  the  Mediterranean 
You  are  in  company  with  a  CVA,  and  three  other  destroyers. 
There  have  been  several  recent  reports  of  UNIDEKTS  in  the 
area  during  the  last  month,  and  at  least  two  Soviet  sub¬ 
marines  are  known  to  be  operating  somewhere  in  the  Med.  at 
the  present  time. 


14.  SPECIAL  ASK  EXERCISE 


You  are  operating  in  a  large  mid-ocean  area  in  company 
with  a  task  group  consistirg  of  an  attack  aircraft  carrier 
and  5  other  destroyers.  There  is  also  an  "enemy"  submarine 
participating  in  the  exercise.  The  general  nature  of  the 
exercise  is  to  gather  data  on  the  ability  of  the  screening 
ships  to  prevent  the  submarine  from  making  a  screen  penetra¬ 
tion  and  obtaining  a  firing  position  on  the  carrier.  You 
know  that  the  submarine  will  attempt  to  penetrate  the  screen 
sometime  during  the  next  4  hours. 


IS.  ASH  TYPE  TRAINING 


You-  are  conducting  ASK  type  training  in  a  local  op 
area.  Other  units  in  company  include  a  destroyer,  two 
fixed-wing  aircraft,  and  two  helicopters.  At  the  beginning 
of  the  exercise,  a  submarine  was  positioned  on  the  surface  10 
miles  ahead.  At  COMEX,  the  submarine  submerged.  You  are 
now  attempting  to  close  the  target,  gain  contact,  and  conduct 
an  attack  on  him. 


16.  WARTIME  HUNTER  KILLER  OPERATIONS 

Your  destroyer  is  one  of  8  destroyers  operating  with  a 
CVS  as  a  hunter  killer  group.  Your  mission  is  to  operate  in 
the  general  area  of  North  Atlantic  shipping  lanes  and  to  seek 
out  and  destroy  enemy  submarines.  Although  your  task  group 
has  been  credited  with  sinking  4  enemy  submarines  in  the  last 
5  days,  all  of  these  sinkings  have  been  the  result  of  the 
action  of  the  air  group  embarked  on  the  carrier.  None  of  the 
destroyers  in  company  have  reported  any  sonar  contacts. 
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DEPLOYMENT  TRANSIT 


17. 

You  are  on  your  way  home  froia  a  seven-month  deployment 
in  company  with  a  carrier,  an  oiler,  and  three  other  destroyers. 
There  are  no  known  submarines  operating  in  the  area. 
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APPENDIX  B 

SOi^AR  OPERATORS*  AND  OFFICERS* 
SURVEY  INSTRUCTIONS 


(Only  those  pages  of  the  Officers*  instructions 
which  differ  froia  the  Operators*  are  included) 
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INTRODUCTION 


Factors  ih  Sonar  Target  detectioh/Reportikg 


As  you  no  doubt  know,  the  Chief  of  Naval  Operations  re¬ 
gards  ASW  readiness/effectiveness  inforaation  as  highly 
iaportant,  and  considerable  effort  has  been  expended  to  ob¬ 
tain  such  inforaation  through  ASW  exercises.  Therefore, 
CNO/DOD  planners  also  wish  to  know  how  such  exercise  data 
can  be  best  related  to  the  expected  perforaance  of  oar  ASW 
forces  during  non-exercise  situations.  Hasan  Factors  Research 
Inc.,  is  under  contract  to  the  Navy  to  investigate  certain 
aspects  of  this  question.  In  order  to  do  this,  we  wish  to 
obtain  your  judgaents  (and  those  of  several  hundred  other 
fleet  ASK  personnel)  concerning  various  operational  situations 

To  obtain  the  desired  inforaation,  we  will  ask  you  to 
Tank  order  a  set  of  scenarios  (printed  on  cards)  according  to 
the  first  instruction  sheet.  To  do  this,  you  can  spread  the 
cards  out  in  front  of  you  and  arrange  then  in  a  single 
coluan--but  you  will  probably  find  it  sore  convenient  to 
actually  fora  three  shorter  coluans  side-by-side,  so  you  can 
easily  see  all  of  the  cards.  When  you  are  satisfied  with  a 
particular  ordering  of  the  cards,  please  write  the  card  nua- 
bers  in  the  boxes  on  the  reverse  side  of  the  instruction 
sheet,  and  ask  for  the  next  insz-ruction  sheet. 

Please  feel  free  to  perfora  these  rankings  in  a  way 
which  will  reflect  your  own  opinion.  Ocr  report  to  the  Navy 
will  be  in  teras  of  trends  and  averages;  only  our  coBpany  re¬ 
search  staff  will  see  the  actual  questionneires  and  answer 
sheets . 

Before  you  begin  the  first  ranking,  please  conplete  the 
biographical  questionnaire  on  the  other  side  of  this  page. 
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Name  o£  Ship 


Type  of  Ship 
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(SONAR  OPERATOR'S  VERSION) 


SONAR  CONTACT  REPORTING 

For  the  purposes  of  this  part,  please  Imagine  that  you 
are  standing  a  sonar  v:atch  aboard  your  ship,  that  you  are  di¬ 
rectly  operating  and  observing  your  sonar,  and  that  you  and 
you  atone  will  make  the  decision  to  report  sonar  detections  to 
the  bridge.  Your  cei'tainty  of  a  contact  depends  on  many  things 
such  as  echo  quality,  consistency,  strength,  and  so  on,  and  you 

can  be  more  sure  of  some  contacts  than  others.  If  you  were  to 

\ 

j 

see/hear  a  very  strong  echo  which  shox^ed  obvious  submarine  tar¬ 
get  cues  or  characteristics,  you  could  report  "possible  sub" 
to  the  bridge  with  little  doubt  or  uncertainty  concerning  the 
contact.  On  the  other  hand,  if  you  were  to  see/hear  an  "echo" 
which  was  very  weak,  inconsistent,  and  lacking  in  cues,  you 
might  not  be  sure  that  you  actually  have  a  contact.  Your 
decision  to  report  such  a  questionable  "contact"  to  the  bridge 
might  depend  upon  the  operational  situation- -for  example,  you 
might  be  more  likely  to  report  such  contacts  during  ’wartime 
ASW  operations  than  you  would  in  non-ASW  peacetime  situations. 
Please  carefully  read  and  consider  each  of  the  situations 
described  on  the  cards,  and  place  tlie  cards  in  rank  order  in 
front  of  you  so  that  the  situation  in  which  lOV  FEEL  YOU 
WOULDN'T  NEED  TO  BE  VEFY  SUP.E  OF  A  CONTACT  TO  HEFORT  "POSSIBLE 
SUB"  TO  THE  BRIDGE  is  at  the  top,  dowmv'ard  situation-by- 
situation,  to  the  situation  for  which  YOU  WOULD  WANT  TO  BE 
PRETTY  SURE  OF  A  CONTACT  TO  REPORT.  After  you  have  done  this, 
please  x^rite  the  card  numbers  in  the  boxes  on  the  other  side 
of  this  page  in  the  order  you  have  placed  the  cards. 


SONAR  CONTACT  REPORTING 


"I  WOULDtrT  HAVE  TO  BE  VERY 
SURE  OF  A  CONTACT  TO  REPORT” 


"J  WOULD  WANT  TO  BE 
PRETTY  SURE  OF  A  CONTACT 
TO  REPORT” 
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(OFFICER'S  VERSION) 


SONAR  CONTACT  REPORTING 

For  the  purposes  of  this  part,  please  imagine  that  you 
are  at  sea.  Sonar's  certainty  of  a  contact  depends  on  many 
things,  such  as  echo  quality,  consistency,  strength,  and  so 
on,  and  they  can  be  more  sure  of  some  contacts  than  others. 

If  they  were  to  see/hear  a  very  strong  echo  which  showed 
obvious  submarine  target  cues  or  characteristics,  they  could 
report  "possible  sub"  to  the  bridge  with  little  doubt  or 
uncertainty  concerning  the  contact.  On  the  other  hand,  if 
they  were  to  see/hear  an  "echo*'  which  was  very  weak,  incon¬ 
sistent,  and  lacking  in  cues,  they  might  not  be  sure  they 
actually  have  a  contact.  You  may  feel  that  their  decision 
to  report  such  a  questionable  "contact"  to  the  bridge  could 
depend  upon  the  operational  situation- -for  example,  they 
might  be  more  likely  to  report  such  contacts  during  xvartiine 
ASW  operations  than  they  would  in  non-ASK  peacetime  situations. 
Please  carefully  read  and  consider  each  of  the  situations 
described  on  the  cards,  and  place  the  cards  in  rank  order  in 
front  of  you  according  to  your  opinion  of  how  sonar  should 
report,  so  that  the  situation  in  which  lOU  F^EL  SOSAR  SEED 
SOT  BE  VERY  SURE  OF  A  COST ACT  TO  REPORT  "POSSIBLE  SUB"  TO  TBE 
BRIDGE  is  at  the  top,  downward  situation-by-situation,  to  the 
situation  for  which  YOU  FEEL  THEY  SHOULD  BE  PRETTY  SURE  OF  A 
CONTACT  TO  REPORT,  After  you  have  done  this,  please  write  the 
card  numbers  in  the  boxes  on  the  other  side  of  this  page  in 
the  order  you  have  placed  the  cards. 
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(SONAR  OPERATOR'S  VERSION) 


CONSEQUENCES  OF  .MISSED  CONTACTS 

For  the  purposes  of  this  part,  pi  ease  iisagine  that  you 
are  the  sonar  operator  anti  that  a  "contact"  briefly  caught 
your  attention,  but  was  so  weak,  intermittent,  and  lacking 
in  cues  that  you  had  little  confidence  that  it  actually  vas 
a  contact  anti  did  not  report  it  to  the  bridge  as  "possible 
submarine."  .At  least  part  of  the  time,  such  contacts  could 
actually  be  caused  by  submarines.  If  it  ici’e  actually  a  sub¬ 
marine,  it  is  a  missed  contact  situation,  which  can  have-  a 
variety  of  cons-’quences .  Your  ship  may  lose  points  during  an 
exercise,  in  time  of  war  your  ship  or  those  in  company  may  be 
torpedoed,  the  submarine  may  move  cut  of  range  and  never  re¬ 
appear,  with  its  existence  remaining  unknown,  and  so  on.  The 
exact  consequences  of  a  missed  contact  may  be  different  for 
different  people,  and  may  depend  upon  the  particular  operational 
situation.  Please  imagine  that  yau  Lave  actually  aissed  a 


contact.  Carefully  consider  what 
contact  might  b''  as  you  see  them 
situations  described  on  the  cards 
order  in  front  of  you  so  that  the 
tact  consequences  are  .^OST  SSVSnE 
I-iOST  USPDEASAHT -to  3/0U  is  at  the 


the  consequences  of  a  missed 
for  each  of  the  operational 
,  and  place  the  cards  in  rank 
situation  whose  missed  con- 
,  MOST  U::DE3IBABLE,  and/or 
top.  downward  situaticn-by- 


situation  co  that  whose  missed  contact  consequences 


SEVERE^  LEAST  UEuESIRASLE 
have  done  this,  please  wr 


,  and/or  LEAST  VVFLE. 
ite  the  card  numbers 


in  the 


are  LSA.ST 
.After  you 
bo.xcs  on 


the  other  side  cf  this  page  in  the  order  you  have  eiaced  the 


(OFFICER'S  VERSION) 


CONS ECU ENCES  OF  MISSED  CONTACTS 


For  the  purposes  of  this  part,  please  Imagine  that  you 
are  at  sea  a'-d  that  a  "contact"  briefly  caught  the  attention 
of  sonar,  but  was  so  vreak,  interniittent ,  an-  .  eking  in  cues 
that  they  had  little  confidence  that  it  actual  /  uas  a  contact 
and  did  not  report  it  to  the  bridge  as  "possible  submarine 
At  least  part  of  the  tine,  such  contacts  could  actually  be 
caused  by  submarines,  if  it  veve  actually  a  submarine,  it 
is  a  missed  contact  situation,  which  can  have  a  variety  of 
consequences.  Your  ship  may  lose  points  during  an  exercise, 
in  time  of  war  ycur  ship  or  those  in  company  nay  be  torpedoed, 
the  submarine  say  move  out  of  range  and  never  reappear,  with 
its  existence  remaining  unknown,  and  so  on.  The  exact  con¬ 
sequences  of  a  missed  contact  may  be  different  for  different 
people,  and  may  depend  upon  the  particular  operational  situa¬ 
tion.  Please  inagi.rie  that  sonar  has  actually  nisasd  a  con¬ 
tact.  Carefully  consider  what  the  consequences  of  a  missed 
contact  might  be  as  you  see  then  for  each  cf  the  operational 
situations  described  on  the  cards,  and  place  the  cards  in  rank 
order  in  front  of  you  so  that  the  situation  r;hosc  missed 
contact  consequences  are  KCSP  SSfEF.E,  HOST  UEDESIRASLS.  and/or 
MOST  unPLEASAil?  to  you  is  at  the  top,  downicard  situation-by¬ 
situation  to  that  whose  missed  contact  consequences  are  LEAST 
SEVSP.E,  LEAST  VuDESIF.ABLEj  and/or  LEAS?  UliPLEASAHT.  After  you 
have  done  this,  please  write  the  card  numbers  in  the  boxes  on 
the  other  side  of  this  page  in  the  order  you  have  placed  -.he 
cards . 
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(SOIIAR  OPERATOR’S  tERSIOll) 


COXSno:*!^CE5  of  false  contac 


irposes  oi  tnis  part,  please 


me  mat  vou 


are  the  sonar  operator  and  that  you  have  reported  a  contact  tc 
the  bridge  as  ’’possible  snbsarine.”  At  least  part  of  the 
tise,  a  contact  reported  as  ’’possible  sub”  turns  out  to  be 
non- submarine-  This  situation  constitutes  a  false  contact, 
and  can  have  a  variety  of  consequences.  Fuel  arsd/or  Keapons 
aay  be  expended,  the  ship  nay  leave  a  p-osition  in  a  screen 
unguarded,  the  ship’s  captain  nay  have  to  be  aisakenad,  and 
so  on.  The  exact  consequences  of  a  false  contact  nay  be 
different  for  different  people,  and  aay  depend  upon  the 
particular  operational  situation-  ?I«.Tse  tosagine  thcit  mou 
hsse  reported  c  false  contad.  Carefully  consider 

shat  the  consequences  of  reporting  a  false  contact  sight  be 
3^  sou  see  them  for  each  of  the  operational  situations 
described  on  the  cards,  and  place  the  cards  in  rank  order  in 

tion  vhosc 


r  .  . . . 


{OFFICER’S  VERSiOH) 


COXSHOjEXCES  or  false  co.ttacts 


For  the  purposes  of  this  part,  please  it^agise  that  you 
are  at  sea  and  that  sonar  has  reported  a  contact  to  the 
bridge  as  "possible  subnarine.’*  At  least  part  of  the  tme, 
a  contact  reported  as  "possible  sub"  tarns  out  to  be  non- 
subaarine.  This  situation  constitutes  a  false  contact,  and 
can  have  a  vat iety  of  consequences-  Fuel  and/or  weapons 
~ay  be  expended,  the  ship  say  leave  a  position  in  a  screen 
unguarded,  the  ship’s  captain  say  have  to  be  awakened,  and 
so  on.  The  exact  consequences  of  a  false  contact  say  be 
different  for  different  people,  and  say  depend  upon  the 
particular  operational  situation.  Picssc  that  sonar 

has  aatualiy  reported  a  /oias  contact.  Carefully  consider 
what  tho  consequences  of  a  false  contact  sight  be  as  you  see 
thes:  for  each  of  the  operational  situations  described  on  the 
cards,  and  place  the  cards  in  rank  order  in  front  of  you  so 
that  the  situation  whose  CONTACT  CJ3SEC:USSCS3  yOtJi.5  BE 

mST  SEFSSS,  MOST  USTESIHA3L-E,  and/or  MOST  VTFLEASAE?  is  at 
sp,  downward  situatlcn-by-situation  to  that  whose  FALSE 
IC7  COESEQUEECeS  SOULS  BE  LEAST  SEVERE^  LEAS?  UEPESIRA3L- 


ad/c 


MSFLSASASr.  After  you  havo  done  this,  p!eas< 


write  the  card  nussbers  in  the  boxes  on  the  other  side  cf  this 


page  in  the  order  you  have  placed  the  cards. 
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FALSE  CONTACTS 


A  quick  detection  and  report  to  tiic  bridge  ’.“.ay  be  is-orc 
inportai'--*-  in  son'.e  situations  than  in  others.  Picase  carefully 
consider  each  of  the  situations  described  on  the  cards  and 
place  the  cards  in  rank  order  in  front  of  you  so  ti\at  the 
situation  for  v;hicli  Ll^LAYIUG  CGiJTACG  RB:POixTi:: :  WOULD  BE  WORST 
is  at  the  fop,  dov;ra.'ard  situation-by -.situat j on  to  that  for 
i-;hich  DELAY Iir:  CONTACT  REPORTIDG  WOULD  3E  LEAST  BAD.  After 
you  have  done  this,  please  write  the  card  ninr.bers  in  the  boxes 


on  the  ether  .side  of  this  page  in  the  order  you  liave  placed 


QUnSTiONNAIRi; 


^  it  t  »/•/!-£  »'*  L*  L,  J. 


:cLECTo  you.^  o^n  OFi::£o:!. 


During  prcsent-dr,y  r.or.-.-.S',-!  pco.oct i.me  ^p-ei-azlci.s  (for 
example,  peacetime  transiting,  non-AS'-V  refresher 
training,  and  so  on)  .  v/iiich  do  you  Icel  sonar  operci- 
tors  sr.Gu'ld  do? 

a.  Repc:  t  fo'>'.'er  false  contacts  than  they  do 
now  ev'cn  though  it  means  increased  delay 
in  reporting. 

_ b.  Continue  present  reporting  practices. 

_  c.  Report  contacts  more  quickly  than  they  do 

now  even  though  it  means  more  false  con¬ 
tacts  . 

During  pmsenb-day  ASW  exGvcisa  situations^  which  do 
you  feel  sonar  operators  shc-uLd  do? 

_  a.  Report  fe’.ver  false  contacts  than  they  do 

now  oven  though  it  means  increased  delay 
in  reporting. 

_  b.  Continue  present  reporting  practices. 

_  c.  Report  contact.®  more  quickly  than  they  do 

now  CYsa  though  it  means  mere  false  con¬ 
tacts  . 


h'hich  ha'.'O  you  found  to  be  true? 

_  a.  Many  more  false  contacts  are  repo  dur¬ 
ing  A.SV;  exercises  than  durine  non-/-.  ./ 
peaceti.r5e  operations. 

_  h,  A  few  mere  false  contacts  are  reported 

during  .-Xi;'.'.'  exercises  than  during  non- 
AS‘./  peacetime  operations. 

_  c.  About  the  same  number  of  false  contacts 

are  reported  during  ASW  exorcises  and 
lion-A.Sh'  peacetime  eperations. 

_  d.  Power  false  contacts  arc  reported  during 

.XSit  exercises  than  during  non-.XSh‘  peace¬ 
time  operations. 

Kov;  much  of  a  problem  do  you  think  false  contacts  would 
be  in  the  event  of  a  v:ar  involving  ASW? 

_  a.  Very  serious  problem. 

_  b.  Serious  problem. 

_  c.  Moderate  problem. 

_  d.  Insignificant  problem. 
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SONAR  CC^TACr  EVALUATION 

You  are  being  asked  Lo  vieK  a  nusber  of  photographic 
slides  of  an  AK/SQS-260C  A-scan  display  judge  whether 
any  signals  appeared  on  the  display  that  you  Kcuid  report 
as  "possible  sub"  contacts  during  routine  non-ASt<  operations 
at  sea.  The  reason  for  doing  this  is  that  y-hile  the  elec¬ 
tronic  operation  the  SQS-26  sonar  is  vrcil  understood  froa 
the  transducer  to  the  displays >  very  little  is  kncKn  (outside 
the  fleet)  about  Khat  constitutes  a  reportable  contact  '«ith 
this  sonar  during  routine  operations  under  actual  sonar  con¬ 
ditions.  »^e  do  not  know  exactly  hoK  sany  contacts  are  in 
these  slides,  or  hoa  sany  would  be  reported.  Therefore,  kb 
vant  your  best  judgisent  of  what  you  would  report  to  the 
bridge  on  your  ship  as  "possible  sab"  contacts  during  routine 
non-ASW  operations  at  sea. 

Please  feel  fret  to  report  in  a  way  which  reflects  the 
way  you  would  report  aboard  your  ship.  You  cannot  be  scored 
"right”  or  "wrong”;  the  results  will  sitmly  be  th-  average 
judgEents  of  sany  operators  froa  several  ‘‘hips  regarding 
what  they  see -in  the  slides  that  they  think  would  be  reported, 

Stide  7i.awin.g  FroceduTs 

As  you  know,  the  SQS- 26CX  A-scan  display  has  a  6 -ping 
history.  In  the  "single-storage"  aode,  and  after  a  display 
erase,  the  outputs  of  the  ^  and  Cif  processing  for  each  ping 
are  recorded  side-by-side  on  the  display  until  the  display 
contains  the  results  of  6  pings.  All  the  slides  you  will  be 
shown  are  grouped  into  "sequences"  of  6  slides,  which  show 
the  results  of  6  consecutive  pings.  Prior  to  photographing 
each  sequence,  the  A-scan  display  was  erased,  and  the  first 
slide  ox  each  sequence  shows  the  results  of  one  ping  only. 

The  second  s_ide  of  each  sequence  was  taken  after  the  next 
ping,  and  because  of  the  display  ECEory  the  second  slide 
shows  the  results  of  the  first  ping  c‘:d  the  second  ping.  The 
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third  slide  shows  the  results  of  pings  1,  2,  and  3;  the  fourth 
slide  shows  pings  1,  2,  3,  and  4;  the  fifth  slide  snows  pings 
1,  2,  3,  4,  and  S;  and  the  sixth  (last)  slide  of  a  sequence 
shows  the  result*^  of  pings  3,  2,  3.  4,  S,  and  6.  Each  and 
every  6-slide  sequence  progressively  shows  the  results  of  6 
consecutive  sonar  pings  which  occurred  one  right  after  the 
other,  ifovsverj  the  various  sequences  were  obtained  at  dif¬ 
ferent  tines,  and  there  nay  be  no  relationship  betv;een  what 
you  ses  in  one  sequence  and  v;hat  you  see  in  another.  But 
within  any  given  sequence,  the  ping  history  develops  just  as 
it  did  on  the  sonar  display. 

Your  slide  projector  will  autonatically  show  you  the 
"next*-  slide  every  2S  seconds.  Therefore,  you  will  be  able 
to  look  at  each  slide  for  25  seconds  before  seeing  the  next; 
tliat  is,  you  'will  be  able  to  look  at  the  results  of  a  given 
ping  (and  any  prior  pings  which  were  stored  on  the  display) 
for  25  seconds  before  seeing  the  results  of  the  next  ping. 

This  is  soaewhat  faster  than  you  would  be  able  to  view  suc¬ 
cessive  pings  at  the  sonar  (the  A- zone  start  was  always  at 
sose  range  froia  own-ship,  and  you  will  be  looking  at  a  20  Kyd 
zone  width)  but  you  should  have  asple  tine  to  scan  the  display 
after  every  ping. 

Each  slide  you  will  see  has  a  four-digit  number  in  the 
lower  right-hand  cornei  which  will  permit  you  to  tell  which 
pings  of  which  sequrr.ee  it  shows.  The  first  two  digits 
identify  the  "sequence";  tJ'.e  last  tiro  digits  identify  the 
"ping  nu:?^er."  As  you  view  successive  slides,  you  will  see 
the  num*. .. iS  develop  in  the  following  way: 


SLIDE  NUMBERS 


WIAT  YOU  SEE  IN  TiIE  SLIDE 


0101 

sequence 

ping  1 

0102 

sequence 

1, 

pings 

0105 

sequence 

1, 

Dings 

*  O 

0104 

sequence 

1. 

pings 
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SLIDE  NUMBERS 


WiAT  you  SEE  IN  THE  SLIDE 


0105 

sequence 

1,  pings  1,  2, 

0106 

sequence 

1,  pings  1,  2, 

0201 

sequence 

2,  ping  1 

0202 

• 

sequence 

2,  pings  152 

• 

• 

• 

2901 

sequence 

• 

• 

29,  ping  1 

2902 

sequence 

29,  pings  i  5 

4,  §  5 
4,5,5 


6 


etc. 


etc. 


You  will  view  a  total  of  72  sequences ,  each  containing  6  con¬ 
secutive  pings.  Since  it  takes  25  seconds  per  slide,  the 
total  viewing  time  will  be  3  hours.  However,  you  will  have 
3  five-minute  breaks,  one  every  45  minutes. 

Contact  Reporting  Procedure 

To  permit  you  to  report  contacts,  you  will  have  a  contact 
reporting  push  button  which,  when  you  push  it,  will  record  the 
ping  number  on  which  you  reported.  In  addition,  you  will  have 
a  number  of  contact  reporting  sheets  to  permit  you  to  record 
the  approximate  range  and  bearing  of  each  contact  you  report 
with  the  push  button.  The  detailed  reporting  procedure  is  as 
follows . 

For  each  sequence,  carefully  search  the  display  for  pos¬ 
sible  contacts  as  the  slides  are  presented  to  you.  If,  for 
example,  something  catches  your  attention  on  the  2nd  ping  of 
the  sequence  which  you  feel  you  would  report  as  a  ’’possible 
sub"  contact  on  your  ship,  push  your  contact  reporting  button 
and  then  immediately  write  in  the  first  line  of  the  "REPORTS" 
block  of  the  contact  revortina  sheet  the  foilciving  information: 

1.  In  the  first  column,  labeled  "SEQ/PING  NUMBER", 
write  the  number  of  the  slide  (seen  in  the 
lower  right  comer)  curino  which  vou  nushed  the 
button. 
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2.  Place  a  died:  in  the  FM  or  CW  coIuess  or  both 
to  indicate  whether  you  see  the  contact  in  the 
left  12  beass  (BI)  or  right  12  beass  (Crf)  or 
both- 

3.  Estinate  which  of  the  12  beaas  the  contact 
appears  to  be  in  and  write  this  bean  nusber 
in  the  coIuesi  labeled  ’’APPROX  BEAM  NO.”. 

The  bean  numbers  on  your  viewing  screen  will 
aid  you. 

4.  Esticate  the  range  of  the  contact  fron  the 
start  of  the  20  Syd  A- zone  in  Kyds  and  write 
this  range  in  the  colunn  labeled  "APPROX 
RANGE  Kyds”.  The  range  nuabers  on  your  view¬ 
ing  screen  will  aid  you. 

5.  If  you  can  determine  whether  the  contact  has 
an  opening  range  rate,  no  range  rate,  or 
closing  range  rate  at  the  ttme  you  report^ 
place  an  appropriate  check  in  one  of  the 
last  three  colusms  of  the  reporting  block. 
Naturally,  to  do  this  yea  will  have  to  be 
viewing  at  least  2  contact  echoes  at  the  tine 
you  report.  If  you  are  not,  make  no  entry  in 
these  columns. 

To  continue  the  example,  you  might  feel  you  would  not 
report  the  "something”  which  caught  your  attention  on  ping 
without  farther  evidence.  In  that  case,  simply  wait  for  ad 
ditional  pings  to  ccee  into  viev:.  Report  on  the  piny  nudbe 
which  you  feel  displays  enough  evidence  that  you  would  repc 
that  contact  as  "possible  sub"  to  the  bridge  of  your  ship 
during  routine  non-ASS?  operations  at  sea.  Do  not  report 
earlier  in  the  sequence  than  this,  and  do  not  report  later 
in  the  sequence  than  this.  If  on  ping  6  of  a  sequence  you 
still  do  not  see  enough  evidence  cf  a  contact,  do  not  repor 
at  all. 

Once  you  have  reported  a  given  contact  in  a  sequence, 
you  should  not  report  it  again  in  that  sequence.  However, 
it  is  possible  that  after  making  a  contact  report  in  a 
given  sequence  you  will  sec  ar.oiher  contact,  in  the  sase  se 
qucr-cc.  which  you  fec-i  would  be  reporreU  also.  In  that  cas 
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push  your  contact  reporting  button  again  and  immediately  record 
the  scquence/ping  number  and  the  range,  bearing,  etc.,  Lnforpia- 
tion  for  the  2n.d  contact  on  your  oontaot  revoj'ting  eheetj  on 
the  line  below  that  used  for  reporting  the  1st  contact.  Every 
time  you  push  the  contact  button,  you  should  make  an  entry  on 
a  line  of  the  contact  reporting  sheet. 

If  you  have  made  a  report  during  any  sequence,  place  an 
appropriate  check  in  Block  II  of  your  contact  reporting  sleet, 
labeled  "CONTACT  QUALITY,  1st  Target,"  during  the  last  ping  of 
that  sequence,  when  you  can  see  all  6  pings.  This  v/ill  permit 
you  to  say  whether  the  reported  contact  is  a  "good,"  "fair,"  or 
"marginal"  contact  after  seeing  all  six  pings;  or  perhaps  you 
would  feel  the  reported  contact  turned  out  to  be  "not  a  con¬ 
tact,"  but  noise  or  reverberation  marks,  in  v.'hich  case  you  can 
check  that  block.  If  you  ho  .e  made  2  reports  during  a  sequence^ 

be  sure  to  place  a  check  in  Block  III  of  your  contact  reporting 

sheet  also,  labeled  "CONTACT  QUALITY,  2nd  Target."  If  you  have 
made  more  than  2  reports  during  a  given  sequence,  you  should 
comment  on  the  3rd  and  subsequent  reports  in  Block  IV  of  your 
contact  reporting  sheet,  labeled  "COI-f-lENTS."  Any  additional 
information  on  reports  1  and  2  may  also  be  placed  in  this 
block  if  you  desire. 

If  you  have  made  any  contact  reports  during  a  given  se¬ 
quence,  you  should  have  entries  in  Blocks,  I,  II,  and  possibly 

III  and  IV  on  your  reporting  sheet  by  the  end  of  that  sequence. 

At  the  beginning  of  the  next  sequence ^  turn  to  the  next  contact 
reporting  sheet.  Each  contact  reporting  sheet  which  is  used 
should  contain  information  concerning  ore  and  only  ping  se¬ 
quence.  You  do  not  have  to  use  a  contact  reporting  sheet 
unless  you  Jiave  made  one  or  more  contact  reports  during  a  se¬ 
quence,  and  it  is  very  unlikely  that  you  will  see  reportable 
contacts  in  all  the  sequences.  But,  when  you  do  make  a  r''port 
and  use  a  contact  reporting  sheet,  be  sure  to  turn  to  a  nc\/ 
one  for  the  next  sequence  in  which  you  wish  to  report. 
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Because  v.-c  want  youT  own  judgment  concerning  contact 
reporting,  we  asl;  you  to  refrain  from  discussions  with  other 
sonarmen  participating  today,  until  you  all  have  completed 
the  task.  Your  cooperation  in  this  task  is  greatly  appre¬ 
ciated.  If  you  have  any  questions  concerning  these  proce¬ 
dures,  pJoase  feel  free  to  ask  the  rcpxesentatiye  in  Iiarge 
of  the  apparatus. 
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IV.  COMMENTS: 


APPENDIX  F 

SONAR  CONTACT  REPORTING  SHEET 
FOR 

THE  ''HIGH"  C0^5>Li:<D  ATTENTION  CONDITION 


iSj 


APPEKPiX  G 

RANKING  INSTRUCT iONS 
A-ND  QUESTIONNAIRE 
AI>MINISTERl'D  TO 
THE  SONAR  OPERATORS 
IfHG  PARTICIPATED  IN 
TiiE  DETECTION  EXPERIMENT 


SCENARIO  RANKING  5  QUESTIONNAIRE 


Please  write  your  NAME:  _ 

On  the  instruction  sheet  (which  is  the  next  page) , 
we  ask  you  to  rank  order  a  -ot  of  scenarios  (printed  on  cards) . 
To  do  this,  you  can  spread  the  cards  out  in  front  of  you  and 
arrange  them  in  a  single  column--but  you  will  probably  find 
it  more  convenient  to  actually  ferm  three  shorter  columns 
side-by-side,  so  you  can  easily  see  all  of  the  cards.  When 
you  are  satisfied  with  a  particular  ordering  of  the  cards, 
please  write  the  card  numbers  in  the  boxes  on  the  reverse 
side  of  the  instruction  sheet.  Then  please  answer  the 
questions  on  the  front  and  back  of  the  last  page,  which  is 
the  questionnaire. 


INSTRUCTION  SHEET 
CONSEQUENCES  OF  FALSE  CONTACTS 

For  the  purposes  of  this  part,  please  imagine  that  you 
are  the  sonar  operator  and  that  you  have  reported  a  contact  to 
the  bridge  as  "possible  submarine."  At  least  part  of  the 
time,  a  contact  reported  as  "possible  sub"  turns  out  to  be 
non- submarine.  This  situation  constitutes  a  false  contact, 
and  can  have  a  variety  of  consequences.  Fuel  and/or  weapons 
may  be  expended,  the  ship  may  leave  a  position  in  a  screen 
unguarded,  the  ship's  captain  may  have  to  be  awakened,  and 
so  on.  The  exact  consequences  of  a  false  contact  may  be 
different  for  different  people,  and  may  depend  upon  the 
particular  operational  situation.  Please  iipanine  that  you 
have  actually  revorted  a  false  contact.  Carefully  consider 
what  the  consequences  of  reporting  a  false  contact  might  be 
as  you  see  them  for  each  of  the  ope’. ational  situations 
described  on  the  cards,  and  place  the  cards  in  rank  order  in 
front  of  you  so  that  the  situation  whose  FALSE  CONTACT  CONSE¬ 
QUENCES  WOULD  BE  MOST  SEVERE^  MOST  UNDESIRABLE,  and/or  MOST 
UNPLEASANT  is  at  the  top,  downward  situation-by-situation 
to  that  whose  FALSE  CONTACT  CONSEQUENCES  WOULD  BE  LEAST  SEVERE, 
LEAST  UNDESIRABLE,  and/or  LEAST  UNPLEASANT.  After  you  have 
done  this,  please  write  the  card  numbers  in  the  boxes  on  the 
other  side  of  this  page  in  the  order  you  have  placed  the  cards. 
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QUESTIONNAiRl: 


FOR  EACH  QVSSTIOn^  CHECK  TEE  GSE  RSSFOHSE  THAT  HOST  ACCUR^ 
ATELI  REFLECTS  lOUR  ORE  OFIUIOn, 


1.  During  present-da^-  non-ASR  peacet-iua  operations  (for 
exaaple,  peacetise  transiting,  non-ASS  refresher 
training,  and  so  on) ,  which  do  you  feel  sonar  opera¬ 
tors  should  do? 

_  a.  Report  fewer  false  contacts  than  they  do 

now  even  though  it  neans  increased  delay 
in  reporting. 

_  b.  Continue  present  reporting  practices. 

_ c.  Report  contacts  BO'^e  quickly  than  they  do 

now  even  though  it  ueans  laore  false  con¬ 
tacts  . 

2.  During  present-day  ASR  esereise  situations,  which  do 
you  feel  sonar  operators  should  do? 

_  a.  Report  fewer  false  contacts  than  they  do 

now  even  though  it  aeans  increased  delay 
in  reporting. 

_ b.  Continue  present  reporting  practices. 

_ c.  Report  contacts  sore  quickly  titan  they  do 

now  even  though  it  aeans  sore  false  con¬ 
tacts  . 

3.  Which  have  you  found  to  be  true? 

_  a.  Many  sore  false  contacts  are  reported  dur¬ 
ing  ASiv  exercises  than  during  non-ASW 
peacetiae  operations. 

_  b.  A  few  sore  false  contacts  are  reported 

during  ASW  exercises  xhan  during  non- 
ASW  peacetiae  operations. 

_  c.-  About  the  sane  nuaber  of  false  contacts 

are  reported  during  ASh'  exercises  and 
non-ASK  peacetiae  operations. 

_  d.  Fewer  false  contacts  are  reported  during 

ASW  exercises  than  during  non-ASsf  peace - 

tise  operations. 

How  such  of  a  probies  do  you  think  false  contacts  would 
be  in  the  event  of  a  war  involving  ASK? 

_  a.  Very  serious  problem. 

_  b.  Serious  problea. 

_  c.  Moderate  problea. 

_ d.  Insignificant  proble=i. 
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At  the  present  tiae,  hort  v.cll  do  you  think  the  i. ridge 
can  judge  the  degree  ot  certainty  t-.hich  sonar  has  about 
an  initial  contact? 

_  a.  Very  accurately. 

_  b.  Accurately. 

_  c.  >iot  very  accurately. 

_  d.  Not  at  all. 

iicv  useful  do  you  think  kno:-:lecge  cf  sonar’s  confidence 
or  certainty  coicerning  an  initial  contact  Kould  be  in 
decision  aaking  on  the  bridge  during  a  uar  involving 
ASK? 

_  a.  Very  useful. 

_  b.  Moderately  useful. 

_  c.  Of  little  use. 

_  d.  Of  no  use. 

Does  the  A-scan  presentation  of  the  particular  nodel 
AH/SQS-25  |AA(R),  BX  or  fXl  aboard  your  ship  differ 
significantly  fros  that  the  AK/SQS-2f*  CX  which  you 
have  seen  pictures  of  today?  in  what  way? 
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